Max level shown:
12025-02-28T11:15:00.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d6a4c5dc-56fb-47b5-89f2-e5c0757e164b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
22025-02-28T11:15:00.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d6a4c5dc-56fb-47b5-89f2-e5c0757e164b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
32025-02-28T11:15:00.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d6a4c5dc-56fb-47b5-89f2-e5c0757e164b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
42025-02-28T11:15:01.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f9f99516-6864-49d5-89b7-29810ad2b64a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
52025-02-28T11:15:01.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f9f99516-6864-49d5-89b7-29810ad2b64a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62025-02-28T11:15:01.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f9f99516-6864-49d5-89b7-29810ad2b64a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72025-02-28T11:15:02.067ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:42055
82025-02-28T11:15:02.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = bc4bf593-f5e0-4179-b434-0f0c3d4217d0 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
92025-02-28T11:15:02.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = bc4bf593-f5e0-4179-b434-0f0c3d4217d0 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
102025-02-28T11:15:02.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3279 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = bc4bf593-f5e0-4179-b434-0f0c3d4217d0 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
112025-02-28T11:15:02.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = a5c69b62-16dc-45f0-8051-e25ea6a07f7d roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
122025-02-28T11:15:02.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = a5c69b62-16dc-45f0-8051-e25ea6a07f7d resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
132025-02-28T11:15:02.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2939 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = a5c69b62-16dc-45f0-8051-e25ea6a07f7d response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
142025-02-28T11:15:02.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 40232c95-3ae8-4430-a19f-fbc037a17a9c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
152025-02-28T11:15:02.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 40232c95-3ae8-4430-a19f-fbc037a17a9c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
162025-02-28T11:15:02.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 40232c95-3ae8-4430-a19f-fbc037a17a9c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
172025-02-28T11:15:03.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 27ca00fe-46e8-49da-8e06-67c0bd641ea6 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
182025-02-28T11:15:03.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 27ca00fe-46e8-49da-8e06-67c0bd641ea6 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
192025-02-28T11:15:03.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 27ca00fe-46e8-49da-8e06-67c0bd641ea6 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
202025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
212025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
222025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
232025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
242025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
252025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
262025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
272025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
282025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
292025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
302025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
312025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
322025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
332025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
342025-02-28T11:15:04.592ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-28 11:05:04.592797567 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
352025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
362025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
372025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
382025-02-28T11:15:04.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
392025-02-28T11:15:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
402025-02-28T11:15:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
412025-02-28T11:15:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
422025-02-28T11:15:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
432025-02-28T11:15:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
442025-02-28T11:15:04.593ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cd949b0-a160-497e-a9d3-708f380c3425.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 145086033 } })
452025-02-28T11:15:04.593ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c58b6d59-7cb2-478f-9d27-4e70c13f0853.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("daf1508c-21c6-4c2b-91a0-3e717092a118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 145088043 } })
462025-02-28T11:15:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
472025-02-28T11:15:04.593ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
482025-02-28T11:15:04.593ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.011632ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
492025-02-28T11:15:04.593ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
502025-02-28T11:15:04.593ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.155235ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
512025-02-28T11:15:04.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
522025-02-28T11:15:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
532025-02-28T11:15:04.594ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
542025-02-28T11:15:04.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 147105467 } })
552025-02-28T11:15:04.595ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
562025-02-28T11:15:04.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
572025-02-28T11:15:04.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
582025-02-28T11:15:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
592025-02-28T11:15:04.597ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
602025-02-28T11:15:04.597ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
612025-02-28T11:15:04.597ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
622025-02-28T11:15:04.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
632025-02-28T11:15:04.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
642025-02-28T11:15:04.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 149582980 } })
652025-02-28T11:15:04.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
662025-02-28T11:15:04.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
672025-02-28T11:15:04.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
682025-02-28T11:15:04.598ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-28 11:05:04.592797567 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
692025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.256032ms iteration = 7 status = {"expiration":"2025-02-28T11:05:04.592797567Z","pruned":[]}
702025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
712025-02-28T11:15:04.598ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 7549b177-a582-4102-91fb-b7e6324fd615
722025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
732025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.87\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"7549b177-a582-4102-91fb-b7e6324fd615"}
742025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
752025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
762025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
772025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
782025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
792025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
802025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
812025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
822025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
832025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
842025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
852025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
862025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
872025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
882025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
892025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
902025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
912025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
922025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
932025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 13 reason = Timeout
942025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
952025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
962025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
972025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
982025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
992025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
1002025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1012025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1022025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
1032025-02-28T11:15:04.598ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1042025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1052025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
1062025-02-28T11:15:04.598ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1072025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1082025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
1092025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1102025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
1112025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1122025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
1132025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1142025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
1152025-02-28T11:15:04.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1162025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1172025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1182025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1192025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1202025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1212025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1222025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1232025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1242025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1252025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1262025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1272025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1282025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
1292025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1302025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1312025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1322025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1332025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1342025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1352025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1362025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1372025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1382025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1392025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1402025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1412025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1422025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1432025-02-28T11:15:04.599ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1442025-02-28T11:15:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1452025-02-28T11:15:04.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1462025-02-28T11:15:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1472025-02-28T11:15:04.601ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.930479ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1482025-02-28T11:15:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
1492025-02-28T11:15:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
1502025-02-28T11:15:04.603ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1512025-02-28T11:15:04.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1522025-02-28T11:15:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1532025-02-28T11:15:04.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1542025-02-28T11:15:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1552025-02-28T11:15:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
1562025-02-28T11:15:04.606ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1572025-02-28T11:15:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1582025-02-28T11:15:04.609ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1592025-02-28T11:15:04.610ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.897375ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
1602025-02-28T11:15:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
1612025-02-28T11:15:04.611ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1622025-02-28T11:15:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1632025-02-28T11:15:04.620ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1642025-02-28T11:15:04.621ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1652025-02-28T11:15:04.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1662025-02-28T11:15:04.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1672025-02-28T11:15:04.623ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1682025-02-28T11:15:04.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1692025-02-28T11:15:04.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1702025-02-28T11:15:04.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
1712025-02-28T11:15:04.627ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1722025-02-28T11:15:04.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1732025-02-28T11:15:04.627ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1742025-02-28T11:15:04.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
1752025-02-28T11:15:04.630ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1762025-02-28T11:15:04.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1772025-02-28T11:15:04.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0672843e-0393-4e45-8642-4e5d4119ad7d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
1782025-02-28T11:15:04.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0672843e-0393-4e45-8642-4e5d4119ad7d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
1792025-02-28T11:15:04.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1802025-02-28T11:15:04.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
1812025-02-28T11:15:04.638ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1822025-02-28T11:15:04.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1832025-02-28T11:15:04.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1842025-02-28T11:15:04.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
1852025-02-28T11:15:04.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1862025-02-28T11:15:04.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1872025-02-28T11:15:04.656ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 57.817138ms iteration = 13 status = {"errors":[],"requests_created_ok":[]}
1882025-02-28T11:15:04.657ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
1892025-02-28T11:15:04.657ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
1902025-02-28T11:15:04.657ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
1912025-02-28T11:15:04.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1922025-02-28T11:15:04.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1932025-02-28T11:15:04.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1942025-02-28T11:15:04.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1952025-02-28T11:15:04.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1962025-02-28T11:15:04.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1972025-02-28T11:15:04.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1982025-02-28T11:15:04.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1992025-02-28T11:15:04.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2002025-02-28T11:15:04.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2012025-02-28T11:15:04.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2022025-02-28T11:15:04.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2032025-02-28T11:15:04.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2042025-02-28T11:15:04.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2052025-02-28T11:15:04.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2062025-02-28T11:15:04.672ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2072025-02-28T11:15:04.672ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2082025-02-28T11:15:04.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2092025-02-28T11:15:04.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2102025-02-28T11:15:04.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2112025-02-28T11:15:04.673ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2122025-02-28T11:15:04.673ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2132025-02-28T11:15:04.673ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2142025-02-28T11:15:04.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2152025-02-28T11:15:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2162025-02-28T11:15:04.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2172025-02-28T11:15:04.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2182025-02-28T11:15:04.674ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2192025-02-28T11:15:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2202025-02-28T11:15:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2212025-02-28T11:15:04.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2222025-02-28T11:15:04.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2232025-02-28T11:15:04.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.394418ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
2242025-02-28T11:15:04.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2252025-02-28T11:15:04.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 45249 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0672843e-0393-4e45-8642-4e5d4119ad7d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
2262025-02-28T11:15:04.678ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2272025-02-28T11:15:04.678ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2282025-02-28T11:15:04.678ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.698237ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2292025-02-28T11:15:04.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2302025-02-28T11:15:04.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2312025-02-28T11:15:04.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2322025-02-28T11:15:04.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2332025-02-28T11:15:04.681ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 233051497 } })
2342025-02-28T11:15:04.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2352025-02-28T11:15:04.681ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
2362025-02-28T11:15:04.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2372025-02-28T11:15:04.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2382025-02-28T11:15:04.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2392025-02-28T11:15:04.682ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2402025-02-28T11:15:04.682ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2412025-02-28T11:15:04.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.089591ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
2422025-02-28T11:15:04.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2432025-02-28T11:15:04.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2442025-02-28T11:15:04.684ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2452025-02-28T11:15:04.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2462025-02-28T11:15:04.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2472025-02-28T11:15:04.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2482025-02-28T11:15:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2492025-02-28T11:15:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2502025-02-28T11:15:04.685ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2512025-02-28T11:15:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2522025-02-28T11:15:04.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2532025-02-28T11:15:04.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2542025-02-28T11:15:04.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2552025-02-28T11:15:04.689ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2562025-02-28T11:15:04.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2572025-02-28T11:15:04.690ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 91.353907ms iteration = 4 status = {"nsuccess":5}
2582025-02-28T11:15:04.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
2592025-02-28T11:15:04.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2602025-02-28T11:15:04.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2612025-02-28T11:15:04.693ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2622025-02-28T11:15:04.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2632025-02-28T11:15:04.694ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2642025-02-28T11:15:04.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2652025-02-28T11:15:04.697ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
2662025-02-28T11:15:04.699ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2672025-02-28T11:15:04.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2682025-02-28T11:15:04.701ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2692025-02-28T11:15:04.701ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2702025-02-28T11:15:04.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2712025-02-28T11:15:04.703ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
2722025-02-28T11:15:04.703ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.99489ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
2732025-02-28T11:15:04.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2742025-02-28T11:15:04.703ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2752025-02-28T11:15:04.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2762025-02-28T11:15:04.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 106.031322ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
2772025-02-28T11:15:04.705ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
2782025-02-28T11:15:04.705ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 107.119994ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
2792025-02-28T11:15:04.711ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2802025-02-28T11:15:04.711ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.918639ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2812025-02-28T11:15:04.712ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2822025-02-28T11:15:04.712ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2832025-02-28T11:15:04.712ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 113.247225ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2842025-02-28T11:15:04.713ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
2852025-02-28T11:15:04.713ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2862025-02-28T11:15:04.713ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
2872025-02-28T11:15:04.714ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bcfbad5-b381-4f4c-81ba-32dd77df8264", "content-length": "26", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} })
2882025-02-28T11:15:04.714ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2892025-02-28T11:15:04.716ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2902025-02-28T11:15:04.716ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2912025-02-28T11:15:04.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2922025-02-28T11:15:04.719ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2932025-02-28T11:15:04.720ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
2942025-02-28T11:15:04.720ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2952025-02-28T11:15:04.720ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "55ac0dca-58f4-40a4-9465-262912388445", "content-length": "26", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} })
2962025-02-28T11:15:04.720ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2972025-02-28T11:15:04.721ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2982025-02-28T11:15:04.721ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2992025-02-28T11:15:04.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3002025-02-28T11:15:04.722ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3012025-02-28T11:15:04.722ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3022025-02-28T11:15:04.722ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3032025-02-28T11:15:04.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3042025-02-28T11:15:04.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3052025-02-28T11:15:04.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3062025-02-28T11:15:04.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3072025-02-28T11:15:04.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3082025-02-28T11:15:04.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3092025-02-28T11:15:04.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3102025-02-28T11:15:04.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3112025-02-28T11:15:04.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3122025-02-28T11:15:04.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3132025-02-28T11:15:04.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3142025-02-28T11:15:04.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3152025-02-28T11:15:04.730ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3162025-02-28T11:15:04.730ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3172025-02-28T11:15:04.730ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3182025-02-28T11:15:04.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 132.385476ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3192025-02-28T11:15:04.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3202025-02-28T11:15:04.733ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3212025-02-28T11:15:04.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3222025-02-28T11:15:04.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 135.345628ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3232025-02-28T11:15:04.734ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
3242025-02-28T11:15:04.734ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3252025-02-28T11:15:04.734ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-28 11:09:18.396893 UTC dns_group = internal generation = 1
3262025-02-28T11:15:04.734ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 141.741686ms iteration = 7 status = {"generation":1}
3272025-02-28T11:15:04.735ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 136.544094ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3282025-02-28T11:15:04.735ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3292025-02-28T11:15:04.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
3302025-02-28T11:15:04.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3312025-02-28T11:15:04.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3322025-02-28T11:15:04.739ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 141.101872ms iteration = 13 status = 0
3332025-02-28T11:15:04.771ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-28T11:09:02.015184Z, time_modified: 2025-02-28T11:09:02.015184Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }) }
3342025-02-28T11:15:04.771ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 178.919942ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]}},"default_endpoint":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3352025-02-28T11:15:04.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3362025-02-28T11:15:04.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3372025-02-28T11:15:04.775ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3382025-02-28T11:15:04.775ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3392025-02-28T11:15:04.775ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 176.50644ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3402025-02-28T11:15:04.776ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3412025-02-28T11:15:04.776ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 0 version = 2
3422025-02-28T11:15:04.776ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3432025-02-28T11:15:04.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3442025-02-28T11:15:04.811ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
3452025-02-28T11:15:04.811ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 212.363768ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
3462025-02-28T11:15:04.813ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 214.756279ms iteration = 15 status = {"physical_disks_added":0}
3472025-02-28T11:15:04.842ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
3482025-02-28T11:15:04.842ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3492025-02-28T11:15:04.843ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a638e192-19f1-4566-9917-8584f6fea570", "content-length": "26", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} })
3502025-02-28T11:15:04.843ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3512025-02-28T11:15:04.844ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
3522025-02-28T11:15:04.858ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 265.21303ms iteration = 13 status = {}
3532025-02-28T11:15:04.863ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3542025-02-28T11:15:04.885ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3552025-02-28T11:15:04.885ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb0309bc-3a2d-490f-93d5-3d5d31fcecdf", "content-length": "1", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} })
3562025-02-28T11:15:04.887ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3572025-02-28T11:15:04.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3582025-02-28T11:15:04.932ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3592025-02-28T11:15:04.932ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e5213f68-7c31-4655-a29d-84073a5c251b", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3602025-02-28T11:15:04.932ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3612025-02-28T11:15:04.934ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "33c2f665-263a-43b7-9969-377ee9f15201", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3622025-02-28T11:15:04.934ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3632025-02-28T11:15:04.936ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3642025-02-28T11:15:04.936ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 344.051508ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3652025-02-28T11:15:04.958ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
3662025-02-28T11:15:04.959ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f1a3a2cf-8f71-4a0b-9e9d-3c806e90ab01", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3672025-02-28T11:15:04.959ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3682025-02-28T11:15:04.961ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "92c32393-aeb6-463b-88f0-b90649b6327e", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3692025-02-28T11:15:04.961ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3702025-02-28T11:15:04.963ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "71f26782-2146-4d48-a0de-0304fa15079e", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3712025-02-28T11:15:04.963ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3722025-02-28T11:15:04.964ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3732025-02-28T11:15:04.964ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3742025-02-28T11:15:04.965ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6049a852-5a9e-476e-850a-8ff990bce923", "content-length": "372", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} })
3752025-02-28T11:15:04.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3762025-02-28T11:15:04.965ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3772025-02-28T11:15:04.965ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 372.6139ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
3782025-02-28T11:15:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3792025-02-28T11:15:04.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3802025-02-28T11:15:04.967ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 374.43471ms iteration = 13 status = null
3812025-02-28T11:15:04.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3822025-02-28T11:15:04.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3832025-02-28T11:15:04.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3842025-02-28T11:15:04.972ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 1 version = 2
3852025-02-28T11:15:04.972ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3862025-02-28T11:15:04.972ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-28 11:09:19.025515 UTC dns_group = external generation = 2
3872025-02-28T11:15:04.972ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 379.278553ms iteration = 7 status = {"generation":2}
3882025-02-28T11:15:05.008ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
3892025-02-28T11:15:05.008ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3902025-02-28T11:15:05.008ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "67425cee-2e03-42be-9d99-f155adfbafa2", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} })
3912025-02-28T11:15:05.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3922025-02-28T11:15:05.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3932025-02-28T11:15:05.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3942025-02-28T11:15:05.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3952025-02-28T11:15:05.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3962025-02-28T11:15:05.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3972025-02-28T11:15:05.017ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3982025-02-28T11:15:05.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3992025-02-28T11:15:05.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a76dcc0d-e8a1-496d-a7ee-fd1c1a9da443", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} })
4002025-02-28T11:15:05.019ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 420.654199ms iteration = 13 status = {}
4012025-02-28T11:15:05.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4022025-02-28T11:15:05.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4032025-02-28T11:15:05.022ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
4042025-02-28T11:15:05.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4052025-02-28T11:15:05.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4062025-02-28T11:15:05.034ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4072025-02-28T11:15:05.034ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b0b3bbb-be87-4137-bc75-4bee8ce1fc34", "content-length": "134", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} })
4082025-02-28T11:15:05.034ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4092025-02-28T11:15:05.034ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
4102025-02-28T11:15:05.035ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4112025-02-28T11:15:05.035ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4122025-02-28T11:15:05.035ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4132025-02-28T11:15:05.035ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4142025-02-28T11:15:05.035ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4152025-02-28T11:15:05.035ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4162025-02-28T11:15:05.035ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4172025-02-28T11:15:05.035ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4182025-02-28T11:15:05.035ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
4192025-02-28T11:15:05.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4202025-02-28T11:15:05.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4212025-02-28T11:15:05.038ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4222025-02-28T11:15:05.038ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f035774d-cd8a-4490-832b-eccd941512d9", "content-length": "2", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} })
4232025-02-28T11:15:05.038ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4242025-02-28T11:15:05.039ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbb2e528-68c9-483d-8327-074a4249397f", "content-length": "52", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} })
4252025-02-28T11:15:05.039ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
4262025-02-28T11:15:05.039ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4272025-02-28T11:15:05.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4282025-02-28T11:15:05.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4292025-02-28T11:15:05.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4302025-02-28T11:15:05.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4312025-02-28T11:15:05.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4322025-02-28T11:15:05.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4332025-02-28T11:15:05.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4342025-02-28T11:15:05.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4352025-02-28T11:15:05.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4362025-02-28T11:15:05.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4372025-02-28T11:15:05.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4382025-02-28T11:15:05.131ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8cd8e369-d951-4ff8-906f-a84c5ae3b9ba", "date": "Fri, 28 Feb 2025 11:15:04 GMT"} })
4392025-02-28T11:15:05.131ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
4402025-02-28T11:15:05.131ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4412025-02-28T11:15:05.132ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "de1f7718-eb3d-418a-8cf9-a6209eb0145b", "content-length": "682", "date": "Fri, 28 Feb 2025 11:15:05 GMT"} })
4422025-02-28T11:15:05.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4432025-02-28T11:15:05.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4442025-02-28T11:15:05.132ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "156a37d0-c9ae-4671-a259-4a9d4d20df72", "content-length": "691", "date": "Fri, 28 Feb 2025 11:15:05 GMT"} })
4452025-02-28T11:15:05.132ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
4462025-02-28T11:15:05.132ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
4472025-02-28T11:15:05.132ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
4482025-02-28T11:15:05.133ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 535.258373ms iteration = 13 status = {}
4492025-02-28T11:15:05.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4502025-02-28T11:15:05.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4512025-02-28T11:15:05.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4522025-02-28T11:15:05.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4532025-02-28T11:15:05.140ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
4542025-02-28T11:15:05.140ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
4552025-02-28T11:15:05.141ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4562025-02-28T11:15:05.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4572025-02-28T11:15:05.148ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 550.243084ms iteration = 13 status = {}
4582025-02-28T11:15:05.171ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
4592025-02-28T11:15:05.172ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:57627
4602025-02-28T11:15:05.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:57627 req_id = 2b05b86c-c2aa-4d2f-a488-16d781b409f5 roles = RoleSet { roles: {} } uri = /metrics/producers
4612025-02-28T11:15:05.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:57627 req_id = 2b05b86c-c2aa-4d2f-a488-16d781b409f5 resource = Database result = Ok(()) uri = /metrics/producers
4622025-02-28T11:15:05.207ZINFOnexus: assigned collector to new producer collector_id = 59e12d21-f0a8-4840-9b1a-87533ec59eae file = nexus/src/app/oximeter.rs:76 producer_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
4632025-02-28T11:15:05.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 35169 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:57627 req_id = 2b05b86c-c2aa-4d2f-a488-16d781b409f5 response_code = 201 uri = /metrics/producers
4642025-02-28T11:15:05.207ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2b05b86c-c2aa-4d2f-a488-16d781b409f5", "content-length": "41", "date": "Fri, 28 Feb 2025 11:15:05 GMT"} })
4652025-02-28T11:15:05.209ZDEBGnexus (producer-registration-task): registered with nexus successfully
4662025-02-28T11:15:05.209ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
4672025-02-28T11:15:05.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ba9788b8-fdc3-4ad4-929a-8d597b6615f1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4682025-02-28T11:15:05.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ba9788b8-fdc3-4ad4-929a-8d597b6615f1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4692025-02-28T11:15:05.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ba9788b8-fdc3-4ad4-929a-8d597b6615f1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4702025-02-28T11:15:06.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9970acf0-dfd9-49f4-b4aa-4de601fa713b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4712025-02-28T11:15:06.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9970acf0-dfd9-49f4-b4aa-4de601fa713b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4722025-02-28T11:15:06.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1951 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9970acf0-dfd9-49f4-b4aa-4de601fa713b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4732025-02-28T11:15:07.081ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 533 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 451506fd-abfd-4b9f-8b32-a8ccbdf576c7 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
4742025-02-28T11:15:07.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5d352cda-f4ef-4313-87b5-c691eedc35a0 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4752025-02-28T11:15:07.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5d352cda-f4ef-4313-87b5-c691eedc35a0 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4762025-02-28T11:15:07.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2423 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5d352cda-f4ef-4313-87b5-c691eedc35a0 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4772025-02-28T11:15:08.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3e3c117e-7226-40d1-bcf6-7eb074367bba roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4782025-02-28T11:15:08.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3e3c117e-7226-40d1-bcf6-7eb074367bba resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4792025-02-28T11:15:08.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2004 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3e3c117e-7226-40d1-bcf6-7eb074367bba response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4802025-02-28T11:15:09.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 36e94ac0-7cf8-4c3a-a8a9-8f74e56abc75 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4812025-02-28T11:15:09.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 36e94ac0-7cf8-4c3a-a8a9-8f74e56abc75 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4822025-02-28T11:15:09.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 36e94ac0-7cf8-4c3a-a8a9-8f74e56abc75 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4832025-02-28T11:15:10.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a447691-f86f-42a2-99c4-670b6d6d0218 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4842025-02-28T11:15:10.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a447691-f86f-42a2-99c4-670b6d6d0218 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4852025-02-28T11:15:10.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1976 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a447691-f86f-42a2-99c4-670b6d6d0218 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4862025-02-28T11:15:11.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1f7941d5-8230-4728-97ce-87ea0f24545e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4872025-02-28T11:15:11.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1f7941d5-8230-4728-97ce-87ea0f24545e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4882025-02-28T11:15:11.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1f7941d5-8230-4728-97ce-87ea0f24545e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4892025-02-28T11:15:12.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c68814db-d9e7-4f3f-a715-e9ca3e587641 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4902025-02-28T11:15:12.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c68814db-d9e7-4f3f-a715-e9ca3e587641 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4912025-02-28T11:15:12.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c68814db-d9e7-4f3f-a715-e9ca3e587641 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4922025-02-28T11:15:13.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cbe00706-3f54-4a9a-a5d2-469e8ea17fbf roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4932025-02-28T11:15:13.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cbe00706-3f54-4a9a-a5d2-469e8ea17fbf resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4942025-02-28T11:15:13.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1462 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cbe00706-3f54-4a9a-a5d2-469e8ea17fbf response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
4952025-02-28T11:15:14.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
4962025-02-28T11:15:14.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4972025-02-28T11:15:14.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4982025-02-28T11:15:14.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
4992025-02-28T11:15:14.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5002025-02-28T11:15:14.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5012025-02-28T11:15:14.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5022025-02-28T11:15:14.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5032025-02-28T11:15:14.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5042025-02-28T11:15:14.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.679789ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5052025-02-28T11:15:14.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5062025-02-28T11:15:14.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5072025-02-28T11:15:14.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5082025-02-28T11:15:14.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5092025-02-28T11:15:14.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5102025-02-28T11:15:14.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5112025-02-28T11:15:14.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
5122025-02-28T11:15:14.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5132025-02-28T11:15:14.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5142025-02-28T11:15:14.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
5152025-02-28T11:15:14.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.177786ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
5162025-02-28T11:15:14.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3f6b1983-5bc0-405f-98b2-6abb85c4e457 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5172025-02-28T11:15:14.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3f6b1983-5bc0-405f-98b2-6abb85c4e457 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5182025-02-28T11:15:14.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3f6b1983-5bc0-405f-98b2-6abb85c4e457 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5192025-02-28T11:15:15.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1e3d81af-8bbc-4654-8714-44ae69d750cc roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5202025-02-28T11:15:15.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1e3d81af-8bbc-4654-8714-44ae69d750cc resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5212025-02-28T11:15:15.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1e3d81af-8bbc-4654-8714-44ae69d750cc response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5222025-02-28T11:15:16.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d52b2198-0830-47e4-9644-2b699d69497c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5232025-02-28T11:15:16.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d52b2198-0830-47e4-9644-2b699d69497c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5242025-02-28T11:15:16.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1940 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d52b2198-0830-47e4-9644-2b699d69497c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5252025-02-28T11:15:17.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 882a58b1-3e6c-4327-95ab-325ba85d8241 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
5262025-02-28T11:15:17.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 882a58b1-3e6c-4327-95ab-325ba85d8241 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
5272025-02-28T11:15:17.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3357 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 882a58b1-3e6c-4327-95ab-325ba85d8241 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
5282025-02-28T11:15:17.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 82d8a309-ea7f-465f-af72-47bae7c3374c roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
5292025-02-28T11:15:17.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 82d8a309-ea7f-465f-af72-47bae7c3374c resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
5302025-02-28T11:15:17.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 82d8a309-ea7f-465f-af72-47bae7c3374c response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
5312025-02-28T11:15:17.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 565 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = a2ed8aaa-3f4e-46ec-91e0-e3b1d0b9604c response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
5322025-02-28T11:15:17.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 411c4b69-5a9b-4327-a56d-c429e8d19119 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5332025-02-28T11:15:17.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 411c4b69-5a9b-4327-a56d-c429e8d19119 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5342025-02-28T11:15:17.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2725 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 411c4b69-5a9b-4327-a56d-c429e8d19119 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5352025-02-28T11:15:18.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8752f10-3b14-4463-8367-7a1bc125fbdf roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5362025-02-28T11:15:18.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8752f10-3b14-4463-8367-7a1bc125fbdf resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5372025-02-28T11:15:18.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2334 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8752f10-3b14-4463-8367-7a1bc125fbdf response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5382025-02-28T11:15:20.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c9551fc5-9583-4c3c-9631-c1c081b5cdc3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5392025-02-28T11:15:20.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c9551fc5-9583-4c3c-9631-c1c081b5cdc3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5402025-02-28T11:15:20.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1834 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c9551fc5-9583-4c3c-9631-c1c081b5cdc3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5412025-02-28T11:15:21.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ab80bafc-c201-48da-b61c-17c539eb5fce roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5422025-02-28T11:15:21.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ab80bafc-c201-48da-b61c-17c539eb5fce resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5432025-02-28T11:15:21.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1577 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ab80bafc-c201-48da-b61c-17c539eb5fce response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5442025-02-28T11:15:22.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 30b4a7d9-bd51-4c69-9e18-f62bea21342c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5452025-02-28T11:15:22.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 30b4a7d9-bd51-4c69-9e18-f62bea21342c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5462025-02-28T11:15:22.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 30b4a7d9-bd51-4c69-9e18-f62bea21342c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5472025-02-28T11:15:23.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b7dc16b4-16ec-4aeb-b26b-cdf160b09d40 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5482025-02-28T11:15:23.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b7dc16b4-16ec-4aeb-b26b-cdf160b09d40 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5492025-02-28T11:15:23.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b7dc16b4-16ec-4aeb-b26b-cdf160b09d40 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5502025-02-28T11:15:24.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cfdd9741-f8a4-48a8-aa70-8372fabc5ede roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5512025-02-28T11:15:24.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cfdd9741-f8a4-48a8-aa70-8372fabc5ede resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5522025-02-28T11:15:24.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2334 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cfdd9741-f8a4-48a8-aa70-8372fabc5ede response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5532025-02-28T11:15:24.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
5542025-02-28T11:15:24.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5552025-02-28T11:15:24.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5562025-02-28T11:15:24.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
5572025-02-28T11:15:24.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5582025-02-28T11:15:24.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5592025-02-28T11:15:24.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602025-02-28T11:15:24.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5612025-02-28T11:15:24.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5622025-02-28T11:15:24.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.584396ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5632025-02-28T11:15:24.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5642025-02-28T11:15:24.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5652025-02-28T11:15:24.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5662025-02-28T11:15:24.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5672025-02-28T11:15:24.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5682025-02-28T11:15:24.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692025-02-28T11:15:24.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
5702025-02-28T11:15:24.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5712025-02-28T11:15:24.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5722025-02-28T11:15:24.617ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
5732025-02-28T11:15:24.617ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.67097ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
5742025-02-28T11:15:25.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bfb3df3e-a329-481f-88e4-5793555ee607 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5752025-02-28T11:15:25.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bfb3df3e-a329-481f-88e4-5793555ee607 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5762025-02-28T11:15:25.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1354 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bfb3df3e-a329-481f-88e4-5793555ee607 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5772025-02-28T11:15:26.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7a789f03-4012-49ff-b35e-74f545c8e358 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5782025-02-28T11:15:26.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7a789f03-4012-49ff-b35e-74f545c8e358 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5792025-02-28T11:15:26.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7a789f03-4012-49ff-b35e-74f545c8e358 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5802025-02-28T11:15:27.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 527 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = e19ebdb7-8d17-4365-973c-5dbabcf1d97f response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
5812025-02-28T11:15:27.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0f33ec8d-e6b8-4203-9cdb-9e3853f07eb8 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5822025-02-28T11:15:27.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0f33ec8d-e6b8-4203-9cdb-9e3853f07eb8 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5832025-02-28T11:15:27.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0f33ec8d-e6b8-4203-9cdb-9e3853f07eb8 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5842025-02-28T11:15:28.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dccf3544-2878-459c-a5f5-08ddf0521192 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5852025-02-28T11:15:28.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dccf3544-2878-459c-a5f5-08ddf0521192 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5862025-02-28T11:15:28.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dccf3544-2878-459c-a5f5-08ddf0521192 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5872025-02-28T11:15:29.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9726e046-8c1c-43f2-8c9a-5bd1b143abd5 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5882025-02-28T11:15:29.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9726e046-8c1c-43f2-8c9a-5bd1b143abd5 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5892025-02-28T11:15:29.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9726e046-8c1c-43f2-8c9a-5bd1b143abd5 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5902025-02-28T11:15:30.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f71d7a30-1022-45bc-a80f-d3cb53427adf roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5912025-02-28T11:15:30.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f71d7a30-1022-45bc-a80f-d3cb53427adf resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5922025-02-28T11:15:30.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1866 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f71d7a30-1022-45bc-a80f-d3cb53427adf response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5932025-02-28T11:15:31.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc23d44e-86a1-4c31-bd37-712a9646faf2 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5942025-02-28T11:15:31.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc23d44e-86a1-4c31-bd37-712a9646faf2 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5952025-02-28T11:15:31.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc23d44e-86a1-4c31-bd37-712a9646faf2 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5962025-02-28T11:15:32.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 684ad1c6-cd9a-4c9d-83dd-1c141fc7c515 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5972025-02-28T11:15:32.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 684ad1c6-cd9a-4c9d-83dd-1c141fc7c515 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5982025-02-28T11:15:32.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 684ad1c6-cd9a-4c9d-83dd-1c141fc7c515 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
5992025-02-28T11:15:33.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fae81dea-3017-46ae-8d4c-07fce05add66 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
6002025-02-28T11:15:33.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fae81dea-3017-46ae-8d4c-07fce05add66 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
6012025-02-28T11:15:33.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fae81dea-3017-46ae-8d4c-07fce05add66 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
6022025-02-28T11:15:34.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f32cc581-77fc-416b-94f5-4fcaa5af47ae roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
6032025-02-28T11:15:34.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f32cc581-77fc-416b-94f5-4fcaa5af47ae resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
6042025-02-28T11:15:34.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f32cc581-77fc-416b-94f5-4fcaa5af47ae response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
6052025-02-28T11:15:34.593ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
6062025-02-28T11:15:34.593ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6072025-02-28T11:15:34.593ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
6082025-02-28T11:15:34.593ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6092025-02-28T11:15:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6102025-02-28T11:15:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6112025-02-28T11:15:34.595ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
6122025-02-28T11:15:34.596ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 147687236 } })
6132025-02-28T11:15:34.596ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
6142025-02-28T11:15:34.596ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 148274269 } })
6152025-02-28T11:15:34.596ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
6162025-02-28T11:15:34.598ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.464104ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6172025-02-28T11:15:34.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
6182025-02-28T11:15:34.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6192025-02-28T11:15:34.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6202025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
6212025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
6222025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6232025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
6242025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6252025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6262025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
6272025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6282025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
6292025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6302025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
6312025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6322025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
6332025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6342025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6352025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
6362025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6372025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
6382025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6392025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
6402025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6412025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
6422025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6432025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
6442025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
6452025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 14 reason = Timeout
6462025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
6472025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
6482025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
6492025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6502025-02-28T11:15:34.599ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6512025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6522025-02-28T11:15:34.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6532025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6542025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6552025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6562025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6572025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6582025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6592025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6602025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6612025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
6622025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6632025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
6642025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
6652025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6662025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6672025-02-28T11:15:34.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682025-02-28T11:15:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6692025-02-28T11:15:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6702025-02-28T11:15:34.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6712025-02-28T11:15:34.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6722025-02-28T11:15:34.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6732025-02-28T11:15:34.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6742025-02-28T11:15:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6752025-02-28T11:15:34.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6762025-02-28T11:15:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6772025-02-28T11:15:34.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6782025-02-28T11:15:34.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6792025-02-28T11:15:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6802025-02-28T11:15:34.605ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6812025-02-28T11:15:34.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6822025-02-28T11:15:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6832025-02-28T11:15:34.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6842025-02-28T11:15:34.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6852025-02-28T11:15:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6862025-02-28T11:15:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6872025-02-28T11:15:34.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6882025-02-28T11:15:34.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.300618ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
6892025-02-28T11:15:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6902025-02-28T11:15:34.608ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6912025-02-28T11:15:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6922025-02-28T11:15:34.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6932025-02-28T11:15:34.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6942025-02-28T11:15:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6952025-02-28T11:15:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6962025-02-28T11:15:34.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6972025-02-28T11:15:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6982025-02-28T11:15:34.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.269152ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
6992025-02-28T11:15:34.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7002025-02-28T11:15:34.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7012025-02-28T11:15:34.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7022025-02-28T11:15:34.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7032025-02-28T11:15:34.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7042025-02-28T11:15:34.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7052025-02-28T11:15:34.615ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7062025-02-28T11:15:34.615ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7072025-02-28T11:15:34.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7082025-02-28T11:15:34.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7092025-02-28T11:15:34.616ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 167721695 } })
7102025-02-28T11:15:34.616ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
7112025-02-28T11:15:34.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7122025-02-28T11:15:34.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7132025-02-28T11:15:34.619ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7142025-02-28T11:15:34.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7152025-02-28T11:15:34.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7162025-02-28T11:15:34.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7172025-02-28T11:15:34.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7182025-02-28T11:15:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7192025-02-28T11:15:34.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7202025-02-28T11:15:34.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7212025-02-28T11:15:34.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7222025-02-28T11:15:34.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
7232025-02-28T11:15:34.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7242025-02-28T11:15:34.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7252025-02-28T11:15:34.628ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7262025-02-28T11:15:34.628ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 29.187935ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7272025-02-28T11:15:34.642ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
7282025-02-28T11:15:34.642ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.816718ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
7292025-02-28T11:15:34.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.300477ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7302025-02-28T11:15:34.652ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7312025-02-28T11:15:34.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7322025-02-28T11:15:34.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7332025-02-28T11:15:34.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7342025-02-28T11:15:34.654ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 54.399785ms iteration = 14 status = {"errors":[],"requests_created_ok":[]}
7352025-02-28T11:15:34.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7362025-02-28T11:15:34.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7372025-02-28T11:15:34.656ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7382025-02-28T11:15:34.657ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7392025-02-28T11:15:34.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7402025-02-28T11:15:34.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7412025-02-28T11:15:34.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.146706ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7422025-02-28T11:15:34.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7432025-02-28T11:15:34.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7442025-02-28T11:15:34.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7452025-02-28T11:15:34.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
7462025-02-28T11:15:34.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7472025-02-28T11:15:34.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7482025-02-28T11:15:34.659ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7492025-02-28T11:15:34.661ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.820294ms iteration = 14 status = 0
7502025-02-28T11:15:34.662ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7512025-02-28T11:15:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7522025-02-28T11:15:34.662ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7532025-02-28T11:15:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7542025-02-28T11:15:34.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7552025-02-28T11:15:34.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 63.726055ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7562025-02-28T11:15:34.665ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7572025-02-28T11:15:34.665ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7582025-02-28T11:15:34.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7592025-02-28T11:15:34.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7602025-02-28T11:15:34.671ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
7612025-02-28T11:15:34.671ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7622025-02-28T11:15:34.672ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4eb1496-0d0b-4150-b566-48d87b81b3e7", "content-length": "26", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
7632025-02-28T11:15:34.672ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7642025-02-28T11:15:34.674ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
7652025-02-28T11:15:34.674ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7662025-02-28T11:15:34.674ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7672025-02-28T11:15:34.674ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c72970e-89f1-4b2e-8265-ad0bfc55effb", "content-length": "26", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
7682025-02-28T11:15:34.674ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7692025-02-28T11:15:34.676ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7702025-02-28T11:15:34.697ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
7712025-02-28T11:15:34.698ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7722025-02-28T11:15:34.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.291955ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7732025-02-28T11:15:34.698ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "17dfeddc-aab9-479d-b50c-cca860e1e508", "content-length": "26", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
7742025-02-28T11:15:34.698ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7752025-02-28T11:15:34.699ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
7762025-02-28T11:15:34.702ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
7772025-02-28T11:15:34.702ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 102.754111ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
7782025-02-28T11:15:34.706ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7792025-02-28T11:15:34.706ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7802025-02-28T11:15:34.706ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.764527ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7812025-02-28T11:15:34.708ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 108.397392ms iteration = 16 status = {"physical_disks_added":0}
7822025-02-28T11:15:34.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7832025-02-28T11:15:34.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7842025-02-28T11:15:34.767ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 173.983396ms iteration = 14 status = {}
7852025-02-28T11:15:34.767ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7862025-02-28T11:15:34.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7872025-02-28T11:15:34.768ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a08a6145-fdcf-4958-9713-245d992b35ee", "content-length": "1", "date": "Fri, 28 Feb 2025 11:15:33 GMT"} })
7882025-02-28T11:15:34.769ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7892025-02-28T11:15:34.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7902025-02-28T11:15:34.770ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7912025-02-28T11:15:34.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7922025-02-28T11:15:34.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7932025-02-28T11:15:34.771ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 177.677695ms iteration = 14 status = null
7942025-02-28T11:15:34.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7952025-02-28T11:15:34.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7962025-02-28T11:15:34.774ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7972025-02-28T11:15:34.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7982025-02-28T11:15:34.788ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7992025-02-28T11:15:34.788ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8002025-02-28T11:15:34.789ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6b33b17-dbb3-4999-9829-df291a92c766", "content-length": "372", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
8012025-02-28T11:15:34.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8022025-02-28T11:15:34.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8032025-02-28T11:15:34.803ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
8042025-02-28T11:15:34.803ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8052025-02-28T11:15:34.840ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8062025-02-28T11:15:34.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8072025-02-28T11:15:34.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8082025-02-28T11:15:34.876ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
8092025-02-28T11:15:34.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8102025-02-28T11:15:34.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8112025-02-28T11:15:34.883ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f6ba0516-ff9d-4c43-aa2d-90e7a7025665", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
8122025-02-28T11:15:34.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8132025-02-28T11:15:34.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8142025-02-28T11:15:34.884ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b829e5a-5329-44c3-80b6-5a0f601bb266", "content-length": "691", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
8152025-02-28T11:15:34.884ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
8162025-02-28T11:15:34.884ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
8172025-02-28T11:15:34.884ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
8182025-02-28T11:15:34.886ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 286.318182ms iteration = 14 status = {}
8192025-02-28T11:15:34.886ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8202025-02-28T11:15:34.886ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc1a43db-f104-43c5-ab36-35919bbde325", "content-length": "134", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
8212025-02-28T11:15:34.886ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8222025-02-28T11:15:34.886ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
8232025-02-28T11:15:34.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8242025-02-28T11:15:34.887ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8252025-02-28T11:15:34.887ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8262025-02-28T11:15:34.887ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8272025-02-28T11:15:34.887ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8282025-02-28T11:15:34.887ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8292025-02-28T11:15:34.887ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8302025-02-28T11:15:34.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8312025-02-28T11:15:34.887ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8322025-02-28T11:15:34.887ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8332025-02-28T11:15:34.887ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
8342025-02-28T11:15:34.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8352025-02-28T11:15:34.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8362025-02-28T11:15:34.890ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8372025-02-28T11:15:34.890ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "43a5fec7-62c1-47fa-97c4-c76334f4a2b8", "content-length": "2", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
8382025-02-28T11:15:34.890ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8392025-02-28T11:15:34.890ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "42174038-9244-418b-b79c-c59a29b4bd65", "content-length": "52", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
8402025-02-28T11:15:34.890ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
8412025-02-28T11:15:34.890ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8422025-02-28T11:15:34.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8432025-02-28T11:15:34.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8442025-02-28T11:15:34.893ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8452025-02-28T11:15:34.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8462025-02-28T11:15:34.983ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "111c6a24-8342-4397-9a91-17a2182cf97f", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
8472025-02-28T11:15:34.983ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
8482025-02-28T11:15:34.983ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8492025-02-28T11:15:34.983ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "61052f2e-d138-4770-8bd7-4d46fab48630", "content-length": "682", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
8502025-02-28T11:15:34.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8512025-02-28T11:15:34.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8522025-02-28T11:15:34.984ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "86e05023-6392-41c9-9468-a891e4c0876c", "date": "Fri, 28 Feb 2025 11:15:34 GMT"} })
8532025-02-28T11:15:34.986ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 386.379755ms iteration = 14 status = {}
8542025-02-28T11:15:34.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8552025-02-28T11:15:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8562025-02-28T11:15:34.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8572025-02-28T11:15:34.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8582025-02-28T11:15:34.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8592025-02-28T11:15:34.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8602025-02-28T11:15:35.004ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 404.419321ms iteration = 14 status = {}
8612025-02-28T11:15:35.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7c81aaa9-f745-4f41-8994-5e4e34001a32 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8622025-02-28T11:15:35.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7c81aaa9-f745-4f41-8994-5e4e34001a32 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8632025-02-28T11:15:35.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1597 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7c81aaa9-f745-4f41-8994-5e4e34001a32 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8642025-02-28T11:15:36.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 001ecde1-a114-42cf-9746-0e391de31e03 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8652025-02-28T11:15:36.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 001ecde1-a114-42cf-9746-0e391de31e03 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8662025-02-28T11:15:36.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 001ecde1-a114-42cf-9746-0e391de31e03 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8672025-02-28T11:15:37.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 594 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = a36c1a1f-6e7d-40ce-bc9a-396a1638d341 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
8682025-02-28T11:15:37.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ce46941f-1ce8-479f-a503-2b065e115b76 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8692025-02-28T11:15:37.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ce46941f-1ce8-479f-a503-2b065e115b76 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8702025-02-28T11:15:37.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2496 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ce46941f-1ce8-479f-a503-2b065e115b76 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8712025-02-28T11:15:38.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d8c4911-6607-4a8b-b0d2-f530d9266cb8 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8722025-02-28T11:15:38.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d8c4911-6607-4a8b-b0d2-f530d9266cb8 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8732025-02-28T11:15:38.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2689 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d8c4911-6607-4a8b-b0d2-f530d9266cb8 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8742025-02-28T11:15:39.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b1fdc6ca-9147-451f-b68c-b2386bdbd90a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8752025-02-28T11:15:39.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b1fdc6ca-9147-451f-b68c-b2386bdbd90a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8762025-02-28T11:15:39.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2040 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b1fdc6ca-9147-451f-b68c-b2386bdbd90a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8772025-02-28T11:15:40.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a719e10-cfa2-4838-af73-0d8619b11b33 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8782025-02-28T11:15:40.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a719e10-cfa2-4838-af73-0d8619b11b33 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8792025-02-28T11:15:40.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1907 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a719e10-cfa2-4838-af73-0d8619b11b33 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8802025-02-28T11:15:41.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ed61a79e-43b1-4758-b9a7-244393ff1397 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8812025-02-28T11:15:41.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ed61a79e-43b1-4758-b9a7-244393ff1397 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8822025-02-28T11:15:41.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ed61a79e-43b1-4758-b9a7-244393ff1397 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8832025-02-28T11:15:42.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3b92e4dd-adeb-4b65-b2b2-7dca219b86a3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8842025-02-28T11:15:42.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3b92e4dd-adeb-4b65-b2b2-7dca219b86a3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8852025-02-28T11:15:42.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3b92e4dd-adeb-4b65-b2b2-7dca219b86a3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8862025-02-28T11:15:43.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1134d454-3d58-4d78-b2a5-7a258c020f3c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8872025-02-28T11:15:43.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1134d454-3d58-4d78-b2a5-7a258c020f3c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8882025-02-28T11:15:43.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1781 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1134d454-3d58-4d78-b2a5-7a258c020f3c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8892025-02-28T11:15:44.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d8db4e7-4ebf-47f3-91fe-188135128477 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8902025-02-28T11:15:44.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d8db4e7-4ebf-47f3-91fe-188135128477 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8912025-02-28T11:15:44.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2662 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d8db4e7-4ebf-47f3-91fe-188135128477 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
8922025-02-28T11:15:44.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
8932025-02-28T11:15:44.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8942025-02-28T11:15:44.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8952025-02-28T11:15:44.598ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
8962025-02-28T11:15:44.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8972025-02-28T11:15:44.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8982025-02-28T11:15:44.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8992025-02-28T11:15:44.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9002025-02-28T11:15:44.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9012025-02-28T11:15:44.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.136737ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9022025-02-28T11:15:44.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9032025-02-28T11:15:44.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9042025-02-28T11:15:44.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9052025-02-28T11:15:44.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9062025-02-28T11:15:44.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9072025-02-28T11:15:44.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9082025-02-28T11:15:44.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
9092025-02-28T11:15:44.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9102025-02-28T11:15:44.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9112025-02-28T11:15:44.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
9122025-02-28T11:15:44.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.277064ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
9132025-02-28T11:15:45.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d0cd850-b6c1-451a-9425-6f8a46ea6fc4 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9142025-02-28T11:15:45.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d0cd850-b6c1-451a-9425-6f8a46ea6fc4 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9152025-02-28T11:15:45.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d0cd850-b6c1-451a-9425-6f8a46ea6fc4 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9162025-02-28T11:15:46.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 863b62e1-aeaf-4c1a-9e5a-98daf1b8d4d9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9172025-02-28T11:15:46.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 863b62e1-aeaf-4c1a-9e5a-98daf1b8d4d9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9182025-02-28T11:15:46.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 863b62e1-aeaf-4c1a-9e5a-98daf1b8d4d9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9192025-02-28T11:15:47.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 7b6324d8-f932-4fb0-88b2-d0309981c3cf roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
9202025-02-28T11:15:47.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 7b6324d8-f932-4fb0-88b2-d0309981c3cf resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
9212025-02-28T11:15:47.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3077 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 7b6324d8-f932-4fb0-88b2-d0309981c3cf response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
9222025-02-28T11:15:47.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 28ae4cb7-886a-40d3-9fd9-db1fece0be04 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
9232025-02-28T11:15:47.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 28ae4cb7-886a-40d3-9fd9-db1fece0be04 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
9242025-02-28T11:15:47.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1703 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42055 req_id = 28ae4cb7-886a-40d3-9fd9-db1fece0be04 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
9252025-02-28T11:15:47.081ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 518 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 63aa468d-01d6-47d7-8df4-2333fdac9da4 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
9262025-02-28T11:15:47.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1855bf41-89dd-48fd-9ce5-65a297f01cb6 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9272025-02-28T11:15:47.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1855bf41-89dd-48fd-9ce5-65a297f01cb6 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9282025-02-28T11:15:47.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1855bf41-89dd-48fd-9ce5-65a297f01cb6 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9292025-02-28T11:15:48.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 108bc761-8fc6-4958-8d6b-be7823b004da roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9302025-02-28T11:15:48.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 108bc761-8fc6-4958-8d6b-be7823b004da resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9312025-02-28T11:15:48.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2053 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 108bc761-8fc6-4958-8d6b-be7823b004da response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9322025-02-28T11:15:49.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1ff5492e-9e95-4cd6-b173-638d2c945d2e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9332025-02-28T11:15:49.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1ff5492e-9e95-4cd6-b173-638d2c945d2e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9342025-02-28T11:15:49.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1ff5492e-9e95-4cd6-b173-638d2c945d2e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9352025-02-28T11:15:50.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3b45d884-3706-483f-aa63-f9a867fe6239 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9362025-02-28T11:15:50.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3b45d884-3706-483f-aa63-f9a867fe6239 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9372025-02-28T11:15:50.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3b45d884-3706-483f-aa63-f9a867fe6239 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9382025-02-28T11:15:51.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6b537ab5-1499-4750-bb68-d3359caf520d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9392025-02-28T11:15:51.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6b537ab5-1499-4750-bb68-d3359caf520d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9402025-02-28T11:15:51.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6b537ab5-1499-4750-bb68-d3359caf520d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9412025-02-28T11:15:52.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4a54ee5e-74bb-4a96-bdc1-1d4f050d44c1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9422025-02-28T11:15:52.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4a54ee5e-74bb-4a96-bdc1-1d4f050d44c1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9432025-02-28T11:15:52.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4a54ee5e-74bb-4a96-bdc1-1d4f050d44c1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9442025-02-28T11:15:53.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cfb52b84-2e12-4750-bf5f-b1ab8a9ce9ed roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9452025-02-28T11:15:53.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cfb52b84-2e12-4750-bf5f-b1ab8a9ce9ed resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9462025-02-28T11:15:53.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2051 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cfb52b84-2e12-4750-bf5f-b1ab8a9ce9ed response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9472025-02-28T11:15:54.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
9482025-02-28T11:15:54.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9492025-02-28T11:15:54.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9502025-02-28T11:15:54.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
9512025-02-28T11:15:54.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9522025-02-28T11:15:54.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9532025-02-28T11:15:54.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9542025-02-28T11:15:54.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9552025-02-28T11:15:54.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9562025-02-28T11:15:54.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9572025-02-28T11:15:54.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9582025-02-28T11:15:54.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9592025-02-28T11:15:54.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.263661ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9602025-02-28T11:15:54.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9612025-02-28T11:15:54.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9622025-02-28T11:15:54.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9632025-02-28T11:15:54.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
9642025-02-28T11:15:54.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9652025-02-28T11:15:54.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9662025-02-28T11:15:54.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
9672025-02-28T11:15:54.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.002962ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
9682025-02-28T11:15:54.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = acc96b72-8c48-4c68-b926-3dbc4a387993 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9692025-02-28T11:15:54.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = acc96b72-8c48-4c68-b926-3dbc4a387993 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9702025-02-28T11:15:54.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1877 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = acc96b72-8c48-4c68-b926-3dbc4a387993 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9712025-02-28T11:15:55.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 84fe0919-64d6-4b99-9a82-e710a811940d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9722025-02-28T11:15:55.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 84fe0919-64d6-4b99-9a82-e710a811940d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9732025-02-28T11:15:55.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 84fe0919-64d6-4b99-9a82-e710a811940d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9742025-02-28T11:15:56.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f17d6373-a0cf-4ff5-94b4-e2119e50b472 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9752025-02-28T11:15:56.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f17d6373-a0cf-4ff5-94b4-e2119e50b472 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9762025-02-28T11:15:56.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2084 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f17d6373-a0cf-4ff5-94b4-e2119e50b472 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9772025-02-28T11:15:57.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 881 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 7770439a-278e-481c-b5e7-058ce56cefd8 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
9782025-02-28T11:15:57.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 94f5f343-2ece-4d9f-a161-6d5090752d44 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9792025-02-28T11:15:57.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 94f5f343-2ece-4d9f-a161-6d5090752d44 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9802025-02-28T11:15:57.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 94f5f343-2ece-4d9f-a161-6d5090752d44 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9812025-02-28T11:15:58.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0bc002cb-d6cc-4eeb-8d9f-325d7cac0437 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9822025-02-28T11:15:58.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0bc002cb-d6cc-4eeb-8d9f-325d7cac0437 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9832025-02-28T11:15:58.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0bc002cb-d6cc-4eeb-8d9f-325d7cac0437 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9842025-02-28T11:15:59.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f108664c-f802-4bcf-ae7b-7168e740d469 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9852025-02-28T11:15:59.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f108664c-f802-4bcf-ae7b-7168e740d469 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9862025-02-28T11:15:59.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2017 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f108664c-f802-4bcf-ae7b-7168e740d469 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9872025-02-28T11:16:00.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e459adff-fd46-4697-9c35-8d55f4bc26c8 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9882025-02-28T11:16:00.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e459adff-fd46-4697-9c35-8d55f4bc26c8 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9892025-02-28T11:16:00.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e459adff-fd46-4697-9c35-8d55f4bc26c8 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9902025-02-28T11:16:01.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ac4facb9-b840-451f-a22f-09bfcb634211 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9912025-02-28T11:16:01.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ac4facb9-b840-451f-a22f-09bfcb634211 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9922025-02-28T11:16:01.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1861 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ac4facb9-b840-451f-a22f-09bfcb634211 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9932025-02-28T11:16:02.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 37dd7d57-7fb4-452c-ab0e-14b3d333ff16 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9942025-02-28T11:16:02.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 37dd7d57-7fb4-452c-ab0e-14b3d333ff16 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9952025-02-28T11:16:02.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 37dd7d57-7fb4-452c-ab0e-14b3d333ff16 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9962025-02-28T11:16:03.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0379f4dd-62f0-4dc5-a917-b27d1611d7f2 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9972025-02-28T11:16:03.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0379f4dd-62f0-4dc5-a917-b27d1611d7f2 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9982025-02-28T11:16:03.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0379f4dd-62f0-4dc5-a917-b27d1611d7f2 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
9992025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
10002025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10012025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
10022025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
10032025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10042025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
10052025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10062025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
10072025-02-28T11:16:04.593ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-28 11:06:04.593224015 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10082025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10092025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
10102025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10112025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10122025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
10132025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
10142025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
10152025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
10162025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10172025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10182025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10192025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10202025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10212025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10222025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10232025-02-28T11:16:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10242025-02-28T11:16:04.593ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c58b6d59-7cb2-478f-9d27-4e70c13f0853.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("daf1508c-21c6-4c2b-91a0-3e717092a118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 145186244 } })
10252025-02-28T11:16:04.594ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cd949b0-a160-497e-a9d3-708f380c3425.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 145372898 } })
10262025-02-28T11:16:04.594ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
10272025-02-28T11:16:04.594ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.598484ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
10282025-02-28T11:16:04.594ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
10292025-02-28T11:16:04.594ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.657986ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
10302025-02-28T11:16:04.595ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
10312025-02-28T11:16:04.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 147230107 } })
10322025-02-28T11:16:04.596ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
10332025-02-28T11:16:04.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10342025-02-28T11:16:04.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10352025-02-28T11:16:04.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 148995725 } })
10362025-02-28T11:16:04.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10372025-02-28T11:16:04.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
10382025-02-28T11:16:04.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10392025-02-28T11:16:04.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
10402025-02-28T11:16:04.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10412025-02-28T11:16:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10422025-02-28T11:16:04.598ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-28 11:06:04.593224015 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
10432025-02-28T11:16:04.598ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.14023ms iteration = 8 status = {"expiration":"2025-02-28T11:06:04.593224015Z","pruned":[]}
10442025-02-28T11:16:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10452025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
10462025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
10472025-02-28T11:16:04.599ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 7549b177-a582-4102-91fb-b7e6324fd615
10482025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10492025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.85\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"7549b177-a582-4102-91fb-b7e6324fd615"}
10502025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
10512025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
10522025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10532025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
10542025-02-28T11:16:04.599ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10552025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10562025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10572025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
10582025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10592025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
10602025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10612025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
10622025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
10632025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10642025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10652025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
10662025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10672025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
10682025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10692025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
10702025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10712025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
10722025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10732025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
10742025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
10752025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
10762025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10772025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
10782025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10792025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
10802025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10812025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
10822025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10832025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
10842025-02-28T11:16:04.599ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10852025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10862025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
10872025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10882025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10892025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10902025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10912025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10922025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10932025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10942025-02-28T11:16:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10952025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10962025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10972025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10982025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
10992025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11002025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11012025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11022025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11032025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11042025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11052025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11062025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11072025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11082025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11092025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11102025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11112025-02-28T11:16:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11122025-02-28T11:16:04.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11132025-02-28T11:16:04.601ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.533459ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11142025-02-28T11:16:04.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11152025-02-28T11:16:04.602ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11162025-02-28T11:16:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11172025-02-28T11:16:04.603ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.308682ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
11182025-02-28T11:16:04.604ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
11192025-02-28T11:16:04.604ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
11202025-02-28T11:16:04.604ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
11212025-02-28T11:16:04.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11222025-02-28T11:16:04.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11232025-02-28T11:16:04.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11242025-02-28T11:16:04.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11252025-02-28T11:16:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
11262025-02-28T11:16:04.606ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11272025-02-28T11:16:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11282025-02-28T11:16:04.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11292025-02-28T11:16:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11302025-02-28T11:16:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11312025-02-28T11:16:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11322025-02-28T11:16:04.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11332025-02-28T11:16:04.606ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11342025-02-28T11:16:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11352025-02-28T11:16:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11362025-02-28T11:16:04.608ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11372025-02-28T11:16:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11382025-02-28T11:16:04.609ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11392025-02-28T11:16:04.609ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11402025-02-28T11:16:04.609ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.927463ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11412025-02-28T11:16:04.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11422025-02-28T11:16:04.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11432025-02-28T11:16:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11442025-02-28T11:16:04.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11452025-02-28T11:16:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11462025-02-28T11:16:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11472025-02-28T11:16:04.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11482025-02-28T11:16:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11492025-02-28T11:16:04.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11502025-02-28T11:16:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11512025-02-28T11:16:04.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11522025-02-28T11:16:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11532025-02-28T11:16:04.619ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 20.156472ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
11542025-02-28T11:16:04.620ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11552025-02-28T11:16:04.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11562025-02-28T11:16:04.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11572025-02-28T11:16:04.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11582025-02-28T11:16:04.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11592025-02-28T11:16:04.622ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11602025-02-28T11:16:04.622ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11612025-02-28T11:16:04.622ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11622025-02-28T11:16:04.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11632025-02-28T11:16:04.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11642025-02-28T11:16:04.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11652025-02-28T11:16:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11662025-02-28T11:16:04.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11672025-02-28T11:16:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11682025-02-28T11:16:04.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11692025-02-28T11:16:04.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11702025-02-28T11:16:04.627ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11712025-02-28T11:16:04.628ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 179837376 } })
11722025-02-28T11:16:04.628ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
11732025-02-28T11:16:04.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11742025-02-28T11:16:04.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
11752025-02-28T11:16:04.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11762025-02-28T11:16:04.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11772025-02-28T11:16:04.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11782025-02-28T11:16:04.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11792025-02-28T11:16:04.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11802025-02-28T11:16:04.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11812025-02-28T11:16:04.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11822025-02-28T11:16:04.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.095788ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
11832025-02-28T11:16:04.653ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
11842025-02-28T11:16:04.653ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
11852025-02-28T11:16:04.653ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
11862025-02-28T11:16:04.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11872025-02-28T11:16:04.654ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 54.659581ms iteration = 17 status = {"physical_disks_added":0}
11882025-02-28T11:16:04.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11892025-02-28T11:16:04.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.961938ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
11902025-02-28T11:16:04.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11912025-02-28T11:16:04.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11922025-02-28T11:16:04.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11932025-02-28T11:16:04.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11942025-02-28T11:16:04.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11952025-02-28T11:16:04.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11962025-02-28T11:16:04.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11972025-02-28T11:16:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11982025-02-28T11:16:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11992025-02-28T11:16:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12002025-02-28T11:16:04.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12012025-02-28T11:16:04.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12022025-02-28T11:16:04.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12032025-02-28T11:16:04.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12042025-02-28T11:16:04.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12052025-02-28T11:16:04.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12062025-02-28T11:16:04.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
12072025-02-28T11:16:04.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12082025-02-28T11:16:04.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12092025-02-28T11:16:04.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12102025-02-28T11:16:04.671ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12112025-02-28T11:16:04.671ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
12122025-02-28T11:16:04.671ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 0 version = 2
12132025-02-28T11:16:04.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12142025-02-28T11:16:04.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12152025-02-28T11:16:04.672ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12162025-02-28T11:16:04.672ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12172025-02-28T11:16:04.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12182025-02-28T11:16:04.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12192025-02-28T11:16:04.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.722327ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12202025-02-28T11:16:04.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12212025-02-28T11:16:04.673ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12222025-02-28T11:16:04.673ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.715948ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12232025-02-28T11:16:04.673ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12242025-02-28T11:16:04.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12252025-02-28T11:16:04.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12262025-02-28T11:16:04.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.621149ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12272025-02-28T11:16:04.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12282025-02-28T11:16:04.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12292025-02-28T11:16:04.676ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12302025-02-28T11:16:04.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12312025-02-28T11:16:04.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12322025-02-28T11:16:04.677ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
12332025-02-28T11:16:04.677ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
12342025-02-28T11:16:04.677ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.909189ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
12352025-02-28T11:16:04.677ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.349838ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12362025-02-28T11:16:04.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12372025-02-28T11:16:04.678ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12382025-02-28T11:16:04.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12392025-02-28T11:16:04.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
12402025-02-28T11:16:04.680ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
12412025-02-28T11:16:04.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12422025-02-28T11:16:04.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
12432025-02-28T11:16:04.682ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12442025-02-28T11:16:04.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12452025-02-28T11:16:04.682ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
12462025-02-28T11:16:04.682ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 82.975717ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
12472025-02-28T11:16:04.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12482025-02-28T11:16:04.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12492025-02-28T11:16:04.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12502025-02-28T11:16:04.684ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.744965ms iteration = 15 status = 0
12512025-02-28T11:16:04.691ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
12522025-02-28T11:16:04.692ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.933102ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
12532025-02-28T11:16:04.693ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12542025-02-28T11:16:04.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12552025-02-28T11:16:04.710ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12562025-02-28T11:16:04.712ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
12572025-02-28T11:16:04.712ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
12582025-02-28T11:16:04.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12592025-02-28T11:16:04.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12602025-02-28T11:16:04.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12612025-02-28T11:16:04.713ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12622025-02-28T11:16:04.713ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12632025-02-28T11:16:04.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12642025-02-28T11:16:04.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12652025-02-28T11:16:04.721ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12662025-02-28T11:16:04.721ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12672025-02-28T11:16:04.721ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.607405ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12682025-02-28T11:16:04.762ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
12692025-02-28T11:16:04.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12702025-02-28T11:16:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12712025-02-28T11:16:04.779ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
12722025-02-28T11:16:04.779ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12732025-02-28T11:16:04.780ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c230f772-8d0c-4f09-8467-9fbbcf14e38b", "content-length": "26", "date": "Fri, 28 Feb 2025 11:16:03 GMT"} })
12742025-02-28T11:16:04.780ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12752025-02-28T11:16:04.781ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12762025-02-28T11:16:04.857ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
12772025-02-28T11:16:04.883ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
12782025-02-28T11:16:04.883ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12792025-02-28T11:16:04.884ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5880f7f-5bcd-4344-baea-e981cf64eeca", "content-length": "26", "date": "Fri, 28 Feb 2025 11:16:03 GMT"} })
12802025-02-28T11:16:04.884ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12812025-02-28T11:16:04.886ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
12822025-02-28T11:16:04.923ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12832025-02-28T11:16:04.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4afac4b8-2cda-4b97-b5c9-f6735a0708d1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
12842025-02-28T11:16:04.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4afac4b8-2cda-4b97-b5c9-f6735a0708d1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
12852025-02-28T11:16:04.944ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
12862025-02-28T11:16:04.944ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12872025-02-28T11:16:04.944ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56eb8f79-0ffb-4243-8c2a-78e3406ea0d6", "content-length": "26", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} })
12882025-02-28T11:16:04.945ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12892025-02-28T11:16:04.947ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12902025-02-28T11:16:04.972ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12912025-02-28T11:16:04.972ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12922025-02-28T11:16:04.972ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "88b388d4-c382-401d-be89-1d3a2e2b5036", "content-length": "372", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} })
12932025-02-28T11:16:04.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12942025-02-28T11:16:04.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12952025-02-28T11:16:04.974ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 1 version = 2
12962025-02-28T11:16:04.974ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
12972025-02-28T11:16:04.974ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-28 11:09:19.025515 UTC dns_group = external generation = 2
12982025-02-28T11:16:04.974ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 381.49836ms iteration = 8 status = {"generation":2}
12992025-02-28T11:16:04.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13002025-02-28T11:16:04.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13012025-02-28T11:16:04.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13022025-02-28T11:16:04.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13032025-02-28T11:16:04.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 38624 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4afac4b8-2cda-4b97-b5c9-f6735a0708d1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
13042025-02-28T11:16:04.982ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
13052025-02-28T11:16:04.982ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13062025-02-28T11:16:04.982ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-28 11:09:18.396893 UTC dns_group = internal generation = 1
13072025-02-28T11:16:04.982ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 389.605984ms iteration = 8 status = {"generation":1}
13082025-02-28T11:16:04.984ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13092025-02-28T11:16:04.984ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "68d77288-31ed-461a-8cf1-2786f1d2635b", "content-length": "1", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} })
13102025-02-28T11:16:04.986ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13112025-02-28T11:16:04.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13122025-02-28T11:16:04.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13132025-02-28T11:16:04.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13142025-02-28T11:16:04.988ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 395.213204ms iteration = 15 status = null
13152025-02-28T11:16:04.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13162025-02-28T11:16:04.990ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13172025-02-28T11:16:04.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13182025-02-28T11:16:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13192025-02-28T11:16:05.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 408.128011ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
13202025-02-28T11:16:05.011ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-28T11:09:02.015184Z, time_modified: 2025-02-28T11:09:02.015184Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }) }
13212025-02-28T11:16:05.011ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 417.830319ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]}},"default_endpoint":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13222025-02-28T11:16:05.032ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
13232025-02-28T11:16:05.032ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13242025-02-28T11:16:05.032ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "116f4ebd-ccb9-4a37-87ad-77dde8e685fd", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} })
13252025-02-28T11:16:05.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13262025-02-28T11:16:05.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13272025-02-28T11:16:05.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13282025-02-28T11:16:05.035ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13292025-02-28T11:16:05.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13302025-02-28T11:16:05.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13312025-02-28T11:16:05.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13322025-02-28T11:16:05.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13332025-02-28T11:16:05.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13342025-02-28T11:16:05.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13352025-02-28T11:16:05.039ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13362025-02-28T11:16:05.040ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e49a765c-707a-4986-9531-210db517dcf2", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13372025-02-28T11:16:05.040ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13382025-02-28T11:16:05.041ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8c30060a-e834-4f7d-9228-faffd530c032", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13392025-02-28T11:16:05.041ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13402025-02-28T11:16:05.041ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13412025-02-28T11:16:05.041ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13422025-02-28T11:16:05.042ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13432025-02-28T11:16:05.042ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 449.727322ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13442025-02-28T11:16:05.046ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
13452025-02-28T11:16:05.046ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 447.26972ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
13462025-02-28T11:16:05.063ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13472025-02-28T11:16:05.064ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "70d31e44-7d32-42ff-a18f-836c226f3e23", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13482025-02-28T11:16:05.064ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13492025-02-28T11:16:05.065ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ff23457c-409a-4388-8bda-8ca2fe54caa5", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13502025-02-28T11:16:05.065ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13512025-02-28T11:16:05.067ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "67e60fff-08f3-4529-a49d-054793094d13", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13522025-02-28T11:16:05.067ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13532025-02-28T11:16:05.070ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13542025-02-28T11:16:05.070ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 476.791561ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13552025-02-28T11:16:05.079ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 486.07158ms iteration = 15 status = {}
13562025-02-28T11:16:05.134ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6adcb031-2085-4110-8131-a87e603b582d", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} })
13572025-02-28T11:16:05.136ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 537.003041ms iteration = 15 status = {}
13582025-02-28T11:16:05.168ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13592025-02-28T11:16:05.168ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad59b450-04d3-477a-9c7d-f0ece5f07ddb", "content-length": "691", "date": "Fri, 28 Feb 2025 11:16:05 GMT"} })
13602025-02-28T11:16:05.168ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
13612025-02-28T11:16:05.168ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
13622025-02-28T11:16:05.168ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
13632025-02-28T11:16:05.170ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 571.296315ms iteration = 15 status = {}
13642025-02-28T11:16:05.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13652025-02-28T11:16:05.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13662025-02-28T11:16:05.205ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
13672025-02-28T11:16:05.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13682025-02-28T11:16:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13692025-02-28T11:16:05.214ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13702025-02-28T11:16:05.215ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "709da3b2-9423-49b1-bd10-c5dc573e8171", "content-length": "134", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} })
13712025-02-28T11:16:05.215ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
13722025-02-28T11:16:05.215ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
13732025-02-28T11:16:05.215ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13742025-02-28T11:16:05.215ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13752025-02-28T11:16:05.215ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13762025-02-28T11:16:05.215ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13772025-02-28T11:16:05.215ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13782025-02-28T11:16:05.215ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13792025-02-28T11:16:05.215ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13802025-02-28T11:16:05.215ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13812025-02-28T11:16:05.215ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
13822025-02-28T11:16:05.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13832025-02-28T11:16:05.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13842025-02-28T11:16:05.217ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13852025-02-28T11:16:05.218ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b50f2f1-f7fb-46d7-815d-cda18a30e889", "content-length": "2", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} })
13862025-02-28T11:16:05.218ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13872025-02-28T11:16:05.218ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfbb7f42-29d5-4d61-8b61-3c681d7f7e6d", "content-length": "52", "date": "Fri, 28 Feb 2025 11:16:04 GMT"} })
13882025-02-28T11:16:05.218ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
13892025-02-28T11:16:05.218ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13902025-02-28T11:16:05.310ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e06a2c36-faa7-49ff-8a7c-3fde7ac18033", "date": "Fri, 28 Feb 2025 11:16:05 GMT"} })
13912025-02-28T11:16:05.310ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
13922025-02-28T11:16:05.310ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13932025-02-28T11:16:05.315ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "09d0b584-0d91-4522-bf25-c0f8d62fbc1f", "content-length": "682", "date": "Fri, 28 Feb 2025 11:16:05 GMT"} })
13942025-02-28T11:16:05.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13952025-02-28T11:16:05.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13962025-02-28T11:16:05.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13972025-02-28T11:16:05.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13982025-02-28T11:16:05.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13992025-02-28T11:16:05.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14002025-02-28T11:16:05.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14012025-02-28T11:16:05.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14022025-02-28T11:16:05.332ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 732.384754ms iteration = 15 status = {}
14032025-02-28T11:16:06.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a18df7c-fb4b-42c6-977b-9b345a885953 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14042025-02-28T11:16:06.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a18df7c-fb4b-42c6-977b-9b345a885953 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14052025-02-28T11:16:06.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a18df7c-fb4b-42c6-977b-9b345a885953 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14062025-02-28T11:16:07.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6d765727-f2dc-4dbe-a91e-960f1b569e4b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14072025-02-28T11:16:07.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6d765727-f2dc-4dbe-a91e-960f1b569e4b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14082025-02-28T11:16:07.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1843 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6d765727-f2dc-4dbe-a91e-960f1b569e4b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14092025-02-28T11:16:07.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 529 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = d985991b-28a7-424c-97dc-62c1d0fff912 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
14102025-02-28T11:16:08.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 832cec9e-3948-425b-801f-bc5033f279c6 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14112025-02-28T11:16:08.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 832cec9e-3948-425b-801f-bc5033f279c6 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14122025-02-28T11:16:08.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 832cec9e-3948-425b-801f-bc5033f279c6 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14132025-02-28T11:16:09.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fb5af23c-09d5-4b99-85e0-123609decf10 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14142025-02-28T11:16:09.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fb5af23c-09d5-4b99-85e0-123609decf10 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14152025-02-28T11:16:09.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2548 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fb5af23c-09d5-4b99-85e0-123609decf10 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14162025-02-28T11:16:10.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 349c613c-ee4e-4e80-ac22-675457e5a69d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14172025-02-28T11:16:10.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 349c613c-ee4e-4e80-ac22-675457e5a69d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14182025-02-28T11:16:10.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 349c613c-ee4e-4e80-ac22-675457e5a69d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14192025-02-28T11:16:11.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8029405e-bb09-453f-8bbb-be961d19f57a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14202025-02-28T11:16:11.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8029405e-bb09-453f-8bbb-be961d19f57a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14212025-02-28T11:16:11.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8029405e-bb09-453f-8bbb-be961d19f57a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14222025-02-28T11:16:12.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 09812e8c-0ca1-4899-86c3-ce7457586c74 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14232025-02-28T11:16:12.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 09812e8c-0ca1-4899-86c3-ce7457586c74 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14242025-02-28T11:16:12.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1921 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 09812e8c-0ca1-4899-86c3-ce7457586c74 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14252025-02-28T11:16:13.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e4c455e-20fa-4198-a997-00a1ab4b5bca roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14262025-02-28T11:16:13.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e4c455e-20fa-4198-a997-00a1ab4b5bca resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14272025-02-28T11:16:13.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e4c455e-20fa-4198-a997-00a1ab4b5bca response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14282025-02-28T11:16:14.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2b1ece2e-5b05-4aea-8adc-cda9c131f3b1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14292025-02-28T11:16:14.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2b1ece2e-5b05-4aea-8adc-cda9c131f3b1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14302025-02-28T11:16:14.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2555 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2b1ece2e-5b05-4aea-8adc-cda9c131f3b1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14312025-02-28T11:16:14.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
14322025-02-28T11:16:14.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14332025-02-28T11:16:14.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14342025-02-28T11:16:14.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
14352025-02-28T11:16:14.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14362025-02-28T11:16:14.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14372025-02-28T11:16:14.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14382025-02-28T11:16:14.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14392025-02-28T11:16:14.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14402025-02-28T11:16:14.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14412025-02-28T11:16:14.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14422025-02-28T11:16:14.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.392082ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14432025-02-28T11:16:14.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14442025-02-28T11:16:14.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14452025-02-28T11:16:14.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14462025-02-28T11:16:14.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14472025-02-28T11:16:14.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
14482025-02-28T11:16:14.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14492025-02-28T11:16:14.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14502025-02-28T11:16:14.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
14512025-02-28T11:16:14.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.588643ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
14522025-02-28T11:16:15.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d5aa2c65-3570-4a07-a483-94e376d8ec1d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14532025-02-28T11:16:15.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d5aa2c65-3570-4a07-a483-94e376d8ec1d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14542025-02-28T11:16:15.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d5aa2c65-3570-4a07-a483-94e376d8ec1d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14552025-02-28T11:16:16.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1db45995-8df2-46c2-9168-1c91b98197d9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14562025-02-28T11:16:16.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1db45995-8df2-46c2-9168-1c91b98197d9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14572025-02-28T11:16:16.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1947 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1db45995-8df2-46c2-9168-1c91b98197d9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14582025-02-28T11:16:17.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 751 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = d1634c9f-e67c-4936-9f14-438db4bd52b9 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
14592025-02-28T11:16:17.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0f338bf8-defd-4d4b-82c9-fc84031ef8b1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14602025-02-28T11:16:17.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0f338bf8-defd-4d4b-82c9-fc84031ef8b1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14612025-02-28T11:16:17.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0f338bf8-defd-4d4b-82c9-fc84031ef8b1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14622025-02-28T11:16:18.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dc441e3d-0663-42d8-9fba-b695e7c0b6d0 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14632025-02-28T11:16:18.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dc441e3d-0663-42d8-9fba-b695e7c0b6d0 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14642025-02-28T11:16:18.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dc441e3d-0663-42d8-9fba-b695e7c0b6d0 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14652025-02-28T11:16:19.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 286cabc3-a7a8-443e-9166-0a5bfc2560fc roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14662025-02-28T11:16:19.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 286cabc3-a7a8-443e-9166-0a5bfc2560fc resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14672025-02-28T11:16:19.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2506 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 286cabc3-a7a8-443e-9166-0a5bfc2560fc response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14682025-02-28T11:16:20.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8dadd6e8-9f53-4850-baa9-5fc648af2f4b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14692025-02-28T11:16:20.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8dadd6e8-9f53-4850-baa9-5fc648af2f4b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14702025-02-28T11:16:20.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2492 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8dadd6e8-9f53-4850-baa9-5fc648af2f4b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14712025-02-28T11:16:21.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1980d8d8-da96-4f68-913f-666c89b6a373 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14722025-02-28T11:16:21.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1980d8d8-da96-4f68-913f-666c89b6a373 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14732025-02-28T11:16:21.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2182 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1980d8d8-da96-4f68-913f-666c89b6a373 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14742025-02-28T11:16:22.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a54aaa91-e447-47b3-bf83-cd7f5cc8c616 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14752025-02-28T11:16:22.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a54aaa91-e447-47b3-bf83-cd7f5cc8c616 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14762025-02-28T11:16:22.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a54aaa91-e447-47b3-bf83-cd7f5cc8c616 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14772025-02-28T11:16:23.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6a863d50-26b6-4c76-a102-8d9d2e57840b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14782025-02-28T11:16:23.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6a863d50-26b6-4c76-a102-8d9d2e57840b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14792025-02-28T11:16:23.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6a863d50-26b6-4c76-a102-8d9d2e57840b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14802025-02-28T11:16:24.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8fcb887-7d7d-4c3f-89eb-4e4207c189fe roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14812025-02-28T11:16:24.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8fcb887-7d7d-4c3f-89eb-4e4207c189fe resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14822025-02-28T11:16:24.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8fcb887-7d7d-4c3f-89eb-4e4207c189fe response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
14832025-02-28T11:16:24.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
14842025-02-28T11:16:24.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14852025-02-28T11:16:24.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14862025-02-28T11:16:24.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
14872025-02-28T11:16:24.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14882025-02-28T11:16:24.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14892025-02-28T11:16:24.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14902025-02-28T11:16:24.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14912025-02-28T11:16:24.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14922025-02-28T11:16:24.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14932025-02-28T11:16:24.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14942025-02-28T11:16:24.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14952025-02-28T11:16:24.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.457184ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14962025-02-28T11:16:24.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14972025-02-28T11:16:24.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14982025-02-28T11:16:24.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14992025-02-28T11:16:24.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
15002025-02-28T11:16:24.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15012025-02-28T11:16:24.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15022025-02-28T11:16:24.617ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
15032025-02-28T11:16:24.617ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.554939ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
15042025-02-28T11:16:25.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 36431c25-179c-46de-9aff-2993eef5d805 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15052025-02-28T11:16:25.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 36431c25-179c-46de-9aff-2993eef5d805 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15062025-02-28T11:16:25.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1705 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 36431c25-179c-46de-9aff-2993eef5d805 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15072025-02-28T11:16:26.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ea50889e-ac83-4486-a77a-b04a1fa2928f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15082025-02-28T11:16:26.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ea50889e-ac83-4486-a77a-b04a1fa2928f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15092025-02-28T11:16:26.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ea50889e-ac83-4486-a77a-b04a1fa2928f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15102025-02-28T11:16:27.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 923 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = c7c50aca-80fa-4c29-b611-e9c09b18fdc1 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
15112025-02-28T11:16:27.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c247cd91-1b44-4931-8ea0-22dbfb51597c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15122025-02-28T11:16:27.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c247cd91-1b44-4931-8ea0-22dbfb51597c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15132025-02-28T11:16:27.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2824 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c247cd91-1b44-4931-8ea0-22dbfb51597c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15142025-02-28T11:16:28.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 03191fe5-99a0-4f0f-960c-d7e69779388d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15152025-02-28T11:16:28.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 03191fe5-99a0-4f0f-960c-d7e69779388d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15162025-02-28T11:16:28.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 03191fe5-99a0-4f0f-960c-d7e69779388d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15172025-02-28T11:16:29.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = aaffa645-2cbb-4b30-ac87-47027eca5401 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15182025-02-28T11:16:29.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = aaffa645-2cbb-4b30-ac87-47027eca5401 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15192025-02-28T11:16:29.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1751 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = aaffa645-2cbb-4b30-ac87-47027eca5401 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15202025-02-28T11:16:30.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 98ad9366-a855-4938-9ac8-3867a4b03d64 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15212025-02-28T11:16:30.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 98ad9366-a855-4938-9ac8-3867a4b03d64 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15222025-02-28T11:16:30.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1796 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 98ad9366-a855-4938-9ac8-3867a4b03d64 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15232025-02-28T11:16:31.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29538d5e-ae57-4817-81a1-39f56dc42f92 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15242025-02-28T11:16:31.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29538d5e-ae57-4817-81a1-39f56dc42f92 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15252025-02-28T11:16:31.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2346 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29538d5e-ae57-4817-81a1-39f56dc42f92 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15262025-02-28T11:16:32.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b9d5e7d1-4409-4f69-9685-ab70d0e061f3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15272025-02-28T11:16:32.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b9d5e7d1-4409-4f69-9685-ab70d0e061f3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15282025-02-28T11:16:32.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1864 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b9d5e7d1-4409-4f69-9685-ab70d0e061f3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15292025-02-28T11:16:33.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fb4478d6-aec2-481f-8dc3-31e8052b20ba roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15302025-02-28T11:16:33.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fb4478d6-aec2-481f-8dc3-31e8052b20ba resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15312025-02-28T11:16:33.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fb4478d6-aec2-481f-8dc3-31e8052b20ba response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15322025-02-28T11:16:34.593ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
15332025-02-28T11:16:34.593ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15342025-02-28T11:16:34.593ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
15352025-02-28T11:16:34.593ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15362025-02-28T11:16:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15372025-02-28T11:16:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15382025-02-28T11:16:34.595ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
15392025-02-28T11:16:34.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 146894980 } })
15402025-02-28T11:16:34.596ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
15412025-02-28T11:16:34.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 148261409 } })
15422025-02-28T11:16:34.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
15432025-02-28T11:16:34.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
15442025-02-28T11:16:34.598ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.71064ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15452025-02-28T11:16:34.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15462025-02-28T11:16:34.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15472025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
15482025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
15492025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15502025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15512025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
15522025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15532025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
15542025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15552025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
15562025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15572025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
15582025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
15592025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15602025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15612025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
15622025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15632025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15642025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
15652025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15662025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
15672025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15682025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
15692025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15702025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
15712025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15722025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
15732025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
15742025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15752025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
15762025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
15772025-02-28T11:16:34.600ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15782025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15792025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15802025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15812025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15822025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15832025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15842025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15852025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15862025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15872025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15882025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15892025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15902025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15912025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
15922025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15932025-02-28T11:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15942025-02-28T11:16:34.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15952025-02-28T11:16:34.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15962025-02-28T11:16:34.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7281727c-3e15-4ee2-9d3b-ec9a199eabf0 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15972025-02-28T11:16:34.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7281727c-3e15-4ee2-9d3b-ec9a199eabf0 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
15982025-02-28T11:16:34.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15992025-02-28T11:16:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16002025-02-28T11:16:34.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16012025-02-28T11:16:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16022025-02-28T11:16:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16032025-02-28T11:16:34.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16042025-02-28T11:16:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16052025-02-28T11:16:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16062025-02-28T11:16:34.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16072025-02-28T11:16:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16082025-02-28T11:16:34.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16092025-02-28T11:16:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16102025-02-28T11:16:34.606ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16112025-02-28T11:16:34.606ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16122025-02-28T11:16:34.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16132025-02-28T11:16:34.606ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16142025-02-28T11:16:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16152025-02-28T11:16:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16162025-02-28T11:16:34.606ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16172025-02-28T11:16:34.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.394268ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
16182025-02-28T11:16:34.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16192025-02-28T11:16:34.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16202025-02-28T11:16:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
16212025-02-28T11:16:34.608ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16222025-02-28T11:16:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16232025-02-28T11:16:34.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16242025-02-28T11:16:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16252025-02-28T11:16:34.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16262025-02-28T11:16:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16272025-02-28T11:16:34.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16282025-02-28T11:16:34.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16292025-02-28T11:16:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16302025-02-28T11:16:34.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16312025-02-28T11:16:34.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16322025-02-28T11:16:34.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16332025-02-28T11:16:34.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 11153 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7281727c-3e15-4ee2-9d3b-ec9a199eabf0 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
16342025-02-28T11:16:34.613ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 13.438228ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
16352025-02-28T11:16:34.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16362025-02-28T11:16:34.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16372025-02-28T11:16:34.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.803519ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16382025-02-28T11:16:34.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.88136ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16392025-02-28T11:16:34.616ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 167453650 } })
16402025-02-28T11:16:34.616ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
16412025-02-28T11:16:34.617ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16422025-02-28T11:16:34.617ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16432025-02-28T11:16:34.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16442025-02-28T11:16:34.617ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16452025-02-28T11:16:34.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16462025-02-28T11:16:34.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16472025-02-28T11:16:34.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16482025-02-28T11:16:34.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16492025-02-28T11:16:34.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16502025-02-28T11:16:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16512025-02-28T11:16:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16522025-02-28T11:16:34.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16532025-02-28T11:16:34.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16542025-02-28T11:16:34.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16552025-02-28T11:16:34.621ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16562025-02-28T11:16:34.621ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16572025-02-28T11:16:34.621ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.263196ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16582025-02-28T11:16:34.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16592025-02-28T11:16:34.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
16602025-02-28T11:16:34.623ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16612025-02-28T11:16:34.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16622025-02-28T11:16:34.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16632025-02-28T11:16:34.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16642025-02-28T11:16:34.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16652025-02-28T11:16:34.634ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 34.009878ms iteration = 18 status = {"physical_disks_added":0}
16662025-02-28T11:16:34.638ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16672025-02-28T11:16:34.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16682025-02-28T11:16:34.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.434347ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
16692025-02-28T11:16:34.643ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16702025-02-28T11:16:34.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16712025-02-28T11:16:34.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16722025-02-28T11:16:34.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16732025-02-28T11:16:34.658ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16742025-02-28T11:16:34.658ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16752025-02-28T11:16:34.658ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 58.063613ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16762025-02-28T11:16:34.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16772025-02-28T11:16:34.660ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
16782025-02-28T11:16:34.660ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 60.70976ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
16792025-02-28T11:16:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
16802025-02-28T11:16:34.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16812025-02-28T11:16:34.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16822025-02-28T11:16:34.688ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16832025-02-28T11:16:34.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16842025-02-28T11:16:34.750ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
16852025-02-28T11:16:34.750ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16862025-02-28T11:16:34.750ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9187cfe3-644c-40fe-9459-101a3c3a2884", "content-length": "26", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
16872025-02-28T11:16:34.750ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16882025-02-28T11:16:34.751ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
16892025-02-28T11:16:34.753ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16902025-02-28T11:16:34.753ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16912025-02-28T11:16:34.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 155.412179ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16922025-02-28T11:16:34.756ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16932025-02-28T11:16:34.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16942025-02-28T11:16:34.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16952025-02-28T11:16:34.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
16962025-02-28T11:16:34.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16972025-02-28T11:16:34.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16982025-02-28T11:16:34.763ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 162.821537ms iteration = 16 status = 0
16992025-02-28T11:16:34.764ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
17002025-02-28T11:16:34.765ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 166.071696ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
17012025-02-28T11:16:34.782ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17022025-02-28T11:16:34.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17032025-02-28T11:16:34.795ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
17042025-02-28T11:16:34.795ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17052025-02-28T11:16:34.795ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d073f0e-6aba-4989-900e-70d9b3247bf6", "content-length": "26", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17062025-02-28T11:16:34.795ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17072025-02-28T11:16:34.797ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17082025-02-28T11:16:34.798ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
17092025-02-28T11:16:34.798ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17102025-02-28T11:16:34.798ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf4617d3-b9fe-4910-b4ed-b5726ae80b43", "content-length": "26", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17112025-02-28T11:16:34.798ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17122025-02-28T11:16:34.800ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17132025-02-28T11:16:34.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 222.182538ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
17142025-02-28T11:16:34.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17152025-02-28T11:16:34.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17162025-02-28T11:16:34.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17172025-02-28T11:16:34.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17182025-02-28T11:16:34.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17192025-02-28T11:16:34.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17202025-02-28T11:16:34.857ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b60e59aa-6574-4d90-8e3f-f32925e6e176", "content-length": "372", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17212025-02-28T11:16:34.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17222025-02-28T11:16:34.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17232025-02-28T11:16:34.858ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17242025-02-28T11:16:34.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17252025-02-28T11:16:34.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17262025-02-28T11:16:34.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17272025-02-28T11:16:34.892ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17282025-02-28T11:16:34.892ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5963843-7eaf-474e-99ef-b562640ca22a", "content-length": "1", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17292025-02-28T11:16:34.894ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17302025-02-28T11:16:34.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17312025-02-28T11:16:34.896ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 303.718565ms iteration = 16 status = null
17322025-02-28T11:16:34.902ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
17332025-02-28T11:16:34.902ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17342025-02-28T11:16:34.903ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e7a17f1e-b21a-4465-abca-b2f3ef009f2b", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17352025-02-28T11:16:34.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17362025-02-28T11:16:34.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17372025-02-28T11:16:34.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17382025-02-28T11:16:34.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17392025-02-28T11:16:34.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17402025-02-28T11:16:34.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17412025-02-28T11:16:34.912ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17422025-02-28T11:16:34.912ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17432025-02-28T11:16:34.913ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "49f7650a-7db2-4548-b84c-9d355c4c5a24", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17442025-02-28T11:16:34.915ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 315.14942ms iteration = 16 status = {}
17452025-02-28T11:16:34.960ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17462025-02-28T11:16:34.960ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c2ff55f-df13-4f3a-9fa5-80e59ee53bc1", "content-length": "691", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17472025-02-28T11:16:34.960ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
17482025-02-28T11:16:34.960ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
17492025-02-28T11:16:34.960ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
17502025-02-28T11:16:34.962ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 362.101775ms iteration = 16 status = {}
17512025-02-28T11:16:34.991ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 398.29491ms iteration = 16 status = {}
17522025-02-28T11:16:35.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17532025-02-28T11:16:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17542025-02-28T11:16:35.032ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
17552025-02-28T11:16:35.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17562025-02-28T11:16:35.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17572025-02-28T11:16:35.042ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17582025-02-28T11:16:35.042ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "71bcd7ad-4a54-4005-9026-02c6d4ff77b7", "content-length": "134", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17592025-02-28T11:16:35.042ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17602025-02-28T11:16:35.042ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
17612025-02-28T11:16:35.043ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17622025-02-28T11:16:35.043ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17632025-02-28T11:16:35.043ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17642025-02-28T11:16:35.043ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17652025-02-28T11:16:35.043ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17662025-02-28T11:16:35.043ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17672025-02-28T11:16:35.043ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17682025-02-28T11:16:35.043ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17692025-02-28T11:16:35.043ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
17702025-02-28T11:16:35.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17712025-02-28T11:16:35.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17722025-02-28T11:16:35.045ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17732025-02-28T11:16:35.046ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5864ed5e-071b-4c44-a6d0-0f5b8be828d6", "content-length": "2", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17742025-02-28T11:16:35.046ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17752025-02-28T11:16:35.046ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "79482460-18c1-470f-b56b-b41065dd2603", "content-length": "52", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17762025-02-28T11:16:35.046ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
17772025-02-28T11:16:35.046ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17782025-02-28T11:16:35.136ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "59e48ce5-fdef-4f28-9085-1b5aeb9d558c", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17792025-02-28T11:16:35.136ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
17802025-02-28T11:16:35.136ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17812025-02-28T11:16:35.136ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7de39237-21aa-41a7-8ffb-05ff342e9697", "content-length": "682", "date": "Fri, 28 Feb 2025 11:16:34 GMT"} })
17822025-02-28T11:16:35.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17832025-02-28T11:16:35.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17842025-02-28T11:16:35.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17852025-02-28T11:16:35.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17862025-02-28T11:16:35.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17872025-02-28T11:16:35.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17882025-02-28T11:16:35.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17892025-02-28T11:16:35.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17902025-02-28T11:16:35.152ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 552.217057ms iteration = 16 status = {}
17912025-02-28T11:16:35.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4d036c56-a2c4-485f-b907-ab634fa0e353 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
17922025-02-28T11:16:35.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4d036c56-a2c4-485f-b907-ab634fa0e353 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
17932025-02-28T11:16:35.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4d036c56-a2c4-485f-b907-ab634fa0e353 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
17942025-02-28T11:16:36.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 47743671-830a-44f1-84bd-a2614793da0a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
17952025-02-28T11:16:36.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 47743671-830a-44f1-84bd-a2614793da0a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
17962025-02-28T11:16:36.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1781 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 47743671-830a-44f1-84bd-a2614793da0a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
17972025-02-28T11:16:37.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 670 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = fef26888-47b0-4180-a3ef-5c276773280e response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
17982025-02-28T11:16:37.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8b64ece7-9e10-4887-a236-40064bf505a2 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
17992025-02-28T11:16:37.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8b64ece7-9e10-4887-a236-40064bf505a2 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18002025-02-28T11:16:37.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8b64ece7-9e10-4887-a236-40064bf505a2 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18012025-02-28T11:16:38.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bb914aca-ef7b-480a-8f1e-ba8f5f51c056 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18022025-02-28T11:16:38.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bb914aca-ef7b-480a-8f1e-ba8f5f51c056 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18032025-02-28T11:16:38.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2423 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bb914aca-ef7b-480a-8f1e-ba8f5f51c056 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18042025-02-28T11:16:39.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 733c8138-96d9-448a-ad96-4b0b66d65d74 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18052025-02-28T11:16:39.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 733c8138-96d9-448a-ad96-4b0b66d65d74 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18062025-02-28T11:16:39.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3111 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 733c8138-96d9-448a-ad96-4b0b66d65d74 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18072025-02-28T11:16:40.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c9a11810-34c2-4aee-8416-4ba802bcfd61 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18082025-02-28T11:16:40.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c9a11810-34c2-4aee-8416-4ba802bcfd61 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18092025-02-28T11:16:40.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2190 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c9a11810-34c2-4aee-8416-4ba802bcfd61 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18102025-02-28T11:16:41.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a764e73c-3314-45d5-b0a6-500dbfff9431 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18112025-02-28T11:16:41.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a764e73c-3314-45d5-b0a6-500dbfff9431 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18122025-02-28T11:16:41.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1616 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a764e73c-3314-45d5-b0a6-500dbfff9431 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18132025-02-28T11:16:42.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ed9ec20c-d9e5-42c4-8d92-5fb43c12d7ce roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18142025-02-28T11:16:42.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ed9ec20c-d9e5-42c4-8d92-5fb43c12d7ce resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18152025-02-28T11:16:42.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ed9ec20c-d9e5-42c4-8d92-5fb43c12d7ce response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18162025-02-28T11:16:43.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f40f8329-f15c-4e36-8fbe-1971eecf7082 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18172025-02-28T11:16:43.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f40f8329-f15c-4e36-8fbe-1971eecf7082 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18182025-02-28T11:16:43.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f40f8329-f15c-4e36-8fbe-1971eecf7082 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18192025-02-28T11:16:44.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
18202025-02-28T11:16:44.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18212025-02-28T11:16:44.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18222025-02-28T11:16:44.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
18232025-02-28T11:16:44.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18242025-02-28T11:16:44.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18252025-02-28T11:16:44.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18262025-02-28T11:16:44.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18272025-02-28T11:16:44.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18282025-02-28T11:16:44.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18292025-02-28T11:16:44.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18302025-02-28T11:16:44.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.447614ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18312025-02-28T11:16:44.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18322025-02-28T11:16:44.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18332025-02-28T11:16:44.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18342025-02-28T11:16:44.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18352025-02-28T11:16:44.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
18362025-02-28T11:16:44.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18372025-02-28T11:16:44.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18382025-02-28T11:16:44.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
18392025-02-28T11:16:44.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.168892ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
18402025-02-28T11:16:44.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4fe043ac-9589-4988-926c-7cc6d235f0e9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18412025-02-28T11:16:44.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4fe043ac-9589-4988-926c-7cc6d235f0e9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18422025-02-28T11:16:44.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2093 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4fe043ac-9589-4988-926c-7cc6d235f0e9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18432025-02-28T11:16:45.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6eeaa52b-a069-4fb9-ba13-b9a434ba3029 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18442025-02-28T11:16:45.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6eeaa52b-a069-4fb9-ba13-b9a434ba3029 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18452025-02-28T11:16:45.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1913 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6eeaa52b-a069-4fb9-ba13-b9a434ba3029 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18462025-02-28T11:16:46.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 58f371aa-d909-45f3-9803-4fe524eff992 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18472025-02-28T11:16:46.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 58f371aa-d909-45f3-9803-4fe524eff992 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18482025-02-28T11:16:46.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 58f371aa-d909-45f3-9803-4fe524eff992 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18492025-02-28T11:16:47.068ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:50644
18502025-02-28T11:16:47.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50644 req_id = 45651383-de5d-4190-a0ef-51707807f3cb roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
18512025-02-28T11:16:47.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50644 req_id = 45651383-de5d-4190-a0ef-51707807f3cb resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
18522025-02-28T11:16:47.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3476 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50644 req_id = 45651383-de5d-4190-a0ef-51707807f3cb response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
18532025-02-28T11:16:47.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50644 req_id = d632ab8e-feca-4383-ae40-7df1d227deb0 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
18542025-02-28T11:16:47.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50644 req_id = d632ab8e-feca-4383-ae40-7df1d227deb0 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
18552025-02-28T11:16:47.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2566 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50644 req_id = d632ab8e-feca-4383-ae40-7df1d227deb0 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
18562025-02-28T11:16:47.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 469 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 40749dde-5455-4466-b606-ed44e33e6a7b response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
18572025-02-28T11:16:47.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9b7dd277-bfc9-48e2-bc2d-a4a3632112ca roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18582025-02-28T11:16:47.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9b7dd277-bfc9-48e2-bc2d-a4a3632112ca resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18592025-02-28T11:16:47.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9b7dd277-bfc9-48e2-bc2d-a4a3632112ca response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18602025-02-28T11:16:48.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a96611b9-6a6e-4e0b-9093-52f36886b877 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18612025-02-28T11:16:48.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a96611b9-6a6e-4e0b-9093-52f36886b877 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18622025-02-28T11:16:48.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a96611b9-6a6e-4e0b-9093-52f36886b877 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18632025-02-28T11:16:49.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3f105562-2322-408f-a0a7-1cc1add24b80 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18642025-02-28T11:16:49.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3f105562-2322-408f-a0a7-1cc1add24b80 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18652025-02-28T11:16:49.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2671 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3f105562-2322-408f-a0a7-1cc1add24b80 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18662025-02-28T11:16:50.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f9e7d82a-18ad-49f0-86cc-189c14aa6380 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18672025-02-28T11:16:50.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f9e7d82a-18ad-49f0-86cc-189c14aa6380 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18682025-02-28T11:16:50.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f9e7d82a-18ad-49f0-86cc-189c14aa6380 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18692025-02-28T11:16:51.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29503f08-023c-4d64-8e83-d45225630802 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18702025-02-28T11:16:51.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29503f08-023c-4d64-8e83-d45225630802 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18712025-02-28T11:16:51.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29503f08-023c-4d64-8e83-d45225630802 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18722025-02-28T11:16:53.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7f49882a-996d-47ae-a3ed-be04094e2444 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18732025-02-28T11:16:53.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7f49882a-996d-47ae-a3ed-be04094e2444 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18742025-02-28T11:16:53.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7f49882a-996d-47ae-a3ed-be04094e2444 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18752025-02-28T11:16:54.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 73f8ac11-f72b-4fba-b4ce-7db0147a6439 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18762025-02-28T11:16:54.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 73f8ac11-f72b-4fba-b4ce-7db0147a6439 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18772025-02-28T11:16:54.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1935 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 73f8ac11-f72b-4fba-b4ce-7db0147a6439 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
18782025-02-28T11:16:54.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
18792025-02-28T11:16:54.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18802025-02-28T11:16:54.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18812025-02-28T11:16:54.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
18822025-02-28T11:16:54.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18832025-02-28T11:16:54.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18842025-02-28T11:16:54.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18852025-02-28T11:16:54.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18862025-02-28T11:16:54.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18872025-02-28T11:16:54.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18882025-02-28T11:16:54.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18892025-02-28T11:16:54.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18902025-02-28T11:16:54.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.739636ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18912025-02-28T11:16:54.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18922025-02-28T11:16:54.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18932025-02-28T11:16:54.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18942025-02-28T11:16:54.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
18952025-02-28T11:16:54.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18962025-02-28T11:16:54.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18972025-02-28T11:16:54.650ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
18982025-02-28T11:16:54.650ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.159527ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
18992025-02-28T11:16:55.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 85265a6c-8078-46fd-8813-941927cbf4c3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19002025-02-28T11:16:55.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 85265a6c-8078-46fd-8813-941927cbf4c3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19012025-02-28T11:16:55.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2710 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 85265a6c-8078-46fd-8813-941927cbf4c3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19022025-02-28T11:16:56.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4f333453-618a-4120-8dae-0c810580ba74 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19032025-02-28T11:16:56.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4f333453-618a-4120-8dae-0c810580ba74 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19042025-02-28T11:16:56.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4f333453-618a-4120-8dae-0c810580ba74 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19052025-02-28T11:16:57.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 602 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 1d08f09b-cbc2-4987-b88e-fde93567e655 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
19062025-02-28T11:16:57.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d89aed6-83e0-4c6b-9747-89ce555d099f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19072025-02-28T11:16:57.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d89aed6-83e0-4c6b-9747-89ce555d099f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19082025-02-28T11:16:57.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d89aed6-83e0-4c6b-9747-89ce555d099f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19092025-02-28T11:16:58.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d1df45b-c47b-4768-be24-6e729251d9c9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19102025-02-28T11:16:58.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d1df45b-c47b-4768-be24-6e729251d9c9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19112025-02-28T11:16:58.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1784 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d1df45b-c47b-4768-be24-6e729251d9c9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19122025-02-28T11:16:59.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0ad25ad0-9bea-46a3-88aa-d5fe835445f1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19132025-02-28T11:16:59.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0ad25ad0-9bea-46a3-88aa-d5fe835445f1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19142025-02-28T11:16:59.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0ad25ad0-9bea-46a3-88aa-d5fe835445f1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19152025-02-28T11:17:00.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c8d0d4bb-7500-4c94-b8cd-934c227d758f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19162025-02-28T11:17:00.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c8d0d4bb-7500-4c94-b8cd-934c227d758f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19172025-02-28T11:17:00.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c8d0d4bb-7500-4c94-b8cd-934c227d758f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19182025-02-28T11:17:01.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8d8c46a-8b10-4ac9-90df-78c60b032ca3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19192025-02-28T11:17:01.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8d8c46a-8b10-4ac9-90df-78c60b032ca3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19202025-02-28T11:17:01.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1868 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8d8c46a-8b10-4ac9-90df-78c60b032ca3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19212025-02-28T11:17:02.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4747cc31-64ba-421b-b8fd-9b5223bd69c7 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19222025-02-28T11:17:02.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4747cc31-64ba-421b-b8fd-9b5223bd69c7 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19232025-02-28T11:17:02.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4747cc31-64ba-421b-b8fd-9b5223bd69c7 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19242025-02-28T11:17:03.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 858c3caa-49ad-49ee-ba4d-726e4124f94c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19252025-02-28T11:17:03.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 858c3caa-49ad-49ee-ba4d-726e4124f94c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19262025-02-28T11:17:03.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1638 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 858c3caa-49ad-49ee-ba4d-726e4124f94c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19272025-02-28T11:17:04.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a0516a5a-295b-476a-9cf1-e68e13407ba0 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19282025-02-28T11:17:04.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a0516a5a-295b-476a-9cf1-e68e13407ba0 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19292025-02-28T11:17:04.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a0516a5a-295b-476a-9cf1-e68e13407ba0 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
19302025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
19312025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
19322025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
19332025-02-28T11:17:04.593ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-28 11:07:04.593605531 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
19342025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
19352025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
19362025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
19372025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19382025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
19392025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
19402025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19412025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
19422025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19432025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
19442025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
19452025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
19462025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19472025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
19482025-02-28T11:17:04.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19492025-02-28T11:17:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19502025-02-28T11:17:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
19512025-02-28T11:17:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19522025-02-28T11:17:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19532025-02-28T11:17:04.594ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c58b6d59-7cb2-478f-9d27-4e70c13f0853.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("daf1508c-21c6-4c2b-91a0-3e717092a118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 145165020 } })
19542025-02-28T11:17:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19552025-02-28T11:17:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19562025-02-28T11:17:04.594ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cd949b0-a160-497e-a9d3-708f380c3425.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 145254712 } })
19572025-02-28T11:17:04.594ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
19582025-02-28T11:17:04.594ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.038453ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
19592025-02-28T11:17:04.594ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
19602025-02-28T11:17:04.594ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.182846ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
19612025-02-28T11:17:04.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19622025-02-28T11:17:04.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19632025-02-28T11:17:04.595ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
19642025-02-28T11:17:04.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19652025-02-28T11:17:04.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19662025-02-28T11:17:04.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19672025-02-28T11:17:04.597ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-28 11:07:04.593605531 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
19682025-02-28T11:17:04.597ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.351623ms iteration = 9 status = {"expiration":"2025-02-28T11:07:04.593605531Z","pruned":[]}
19692025-02-28T11:17:04.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
19702025-02-28T11:17:04.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19712025-02-28T11:17:04.598ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19722025-02-28T11:17:04.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19732025-02-28T11:17:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19742025-02-28T11:17:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19752025-02-28T11:17:04.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 150122816 } })
19762025-02-28T11:17:04.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
19772025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
19782025-02-28T11:17:04.599ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 7549b177-a582-4102-91fb-b7e6324fd615
19792025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.781\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"7549b177-a582-4102-91fb-b7e6324fd615"}
19802025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
19812025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19822025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
19832025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19842025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
19852025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
19862025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19872025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
19882025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
19892025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19902025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
19912025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
19922025-02-28T11:17:04.599ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
19932025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19942025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19952025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
19962025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
19972025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19982025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19992025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
20002025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20012025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
20022025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20032025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20042025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
20052025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20062025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
20072025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20082025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
20092025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20102025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
20112025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
20122025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20132025-02-28T11:17:04.599ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20142025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20152025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
20162025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
20172025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
20182025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
20192025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
20202025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20212025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20222025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20232025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20242025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20252025-02-28T11:17:04.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 150878053 } })
20262025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
20272025-02-28T11:17:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20282025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20292025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20302025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20312025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20322025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20332025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20342025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20352025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20362025-02-28T11:17:04.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
20372025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20382025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
20392025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20402025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
20412025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20422025-02-28T11:17:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20432025-02-28T11:17:04.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20442025-02-28T11:17:04.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20452025-02-28T11:17:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20462025-02-28T11:17:04.603ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.48819ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20472025-02-28T11:17:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20482025-02-28T11:17:04.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20492025-02-28T11:17:04.606ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20502025-02-28T11:17:04.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20512025-02-28T11:17:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
20522025-02-28T11:17:04.608ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20532025-02-28T11:17:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20542025-02-28T11:17:04.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20552025-02-28T11:17:04.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20562025-02-28T11:17:04.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20572025-02-28T11:17:04.613ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20582025-02-28T11:17:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20592025-02-28T11:17:04.617ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20602025-02-28T11:17:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20612025-02-28T11:17:04.625ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.994017ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
20622025-02-28T11:17:04.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20632025-02-28T11:17:04.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20642025-02-28T11:17:04.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20652025-02-28T11:17:04.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20662025-02-28T11:17:04.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20672025-02-28T11:17:04.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20682025-02-28T11:17:04.647ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
20692025-02-28T11:17:04.647ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
20702025-02-28T11:17:04.647ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
20712025-02-28T11:17:04.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20722025-02-28T11:17:04.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20732025-02-28T11:17:04.648ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20742025-02-28T11:17:04.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20752025-02-28T11:17:04.661ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
20762025-02-28T11:17:04.662ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
20772025-02-28T11:17:04.662ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
20782025-02-28T11:17:04.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20792025-02-28T11:17:04.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20802025-02-28T11:17:04.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20812025-02-28T11:17:04.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20822025-02-28T11:17:04.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20832025-02-28T11:17:04.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.321579ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
20842025-02-28T11:17:04.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.169617ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
20852025-02-28T11:17:04.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20862025-02-28T11:17:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20872025-02-28T11:17:04.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20882025-02-28T11:17:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20892025-02-28T11:17:04.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20902025-02-28T11:17:04.668ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20912025-02-28T11:17:04.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20922025-02-28T11:17:04.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.937338ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20932025-02-28T11:17:04.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20942025-02-28T11:17:04.671ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
20952025-02-28T11:17:04.671ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
20962025-02-28T11:17:04.671ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.962161ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
20972025-02-28T11:17:04.672ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20982025-02-28T11:17:04.672ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20992025-02-28T11:17:04.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21002025-02-28T11:17:04.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21012025-02-28T11:17:04.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21022025-02-28T11:17:04.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21032025-02-28T11:17:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21042025-02-28T11:17:04.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21052025-02-28T11:17:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21062025-02-28T11:17:04.678ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21072025-02-28T11:17:04.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21082025-02-28T11:17:04.681ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 232708025 } })
21092025-02-28T11:17:04.682ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
21102025-02-28T11:17:04.684ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21112025-02-28T11:17:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21122025-02-28T11:17:04.685ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21132025-02-28T11:17:04.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21142025-02-28T11:17:04.686ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21152025-02-28T11:17:04.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.013513ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21162025-02-28T11:17:04.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21172025-02-28T11:17:04.687ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21182025-02-28T11:17:04.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21192025-02-28T11:17:04.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21202025-02-28T11:17:04.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21212025-02-28T11:17:04.688ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21222025-02-28T11:17:04.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21232025-02-28T11:17:04.689ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21242025-02-28T11:17:04.690ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 91.130561ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
21252025-02-28T11:17:04.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21262025-02-28T11:17:04.691ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21272025-02-28T11:17:04.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21282025-02-28T11:17:04.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21292025-02-28T11:17:04.693ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21302025-02-28T11:17:04.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21312025-02-28T11:17:04.693ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21322025-02-28T11:17:04.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
21332025-02-28T11:17:04.694ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21342025-02-28T11:17:04.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21352025-02-28T11:17:04.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21362025-02-28T11:17:04.696ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21372025-02-28T11:17:04.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21382025-02-28T11:17:04.699ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
21392025-02-28T11:17:04.699ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 99.288866ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
21402025-02-28T11:17:04.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21412025-02-28T11:17:04.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21422025-02-28T11:17:04.704ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21432025-02-28T11:17:04.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21442025-02-28T11:17:04.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21452025-02-28T11:17:04.707ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.885231ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21462025-02-28T11:17:04.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
21472025-02-28T11:17:04.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21482025-02-28T11:17:04.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21492025-02-28T11:17:04.712ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.475389ms iteration = 17 status = 0
21502025-02-28T11:17:04.714ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
21512025-02-28T11:17:04.714ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
21522025-02-28T11:17:04.714ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 114.914921ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
21532025-02-28T11:17:04.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21542025-02-28T11:17:04.716ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21552025-02-28T11:17:04.716ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 117.142928ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21562025-02-28T11:17:04.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
21572025-02-28T11:17:04.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21582025-02-28T11:17:04.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21592025-02-28T11:17:04.719ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21602025-02-28T11:17:04.719ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21612025-02-28T11:17:04.719ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21622025-02-28T11:17:04.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21632025-02-28T11:17:04.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21642025-02-28T11:17:04.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21652025-02-28T11:17:04.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21662025-02-28T11:17:04.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21672025-02-28T11:17:04.724ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
21682025-02-28T11:17:04.724ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 0 version = 2
21692025-02-28T11:17:04.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21702025-02-28T11:17:04.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21712025-02-28T11:17:04.726ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
21722025-02-28T11:17:04.726ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
21732025-02-28T11:17:04.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21742025-02-28T11:17:04.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21752025-02-28T11:17:04.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21762025-02-28T11:17:04.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21772025-02-28T11:17:04.728ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
21782025-02-28T11:17:04.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21792025-02-28T11:17:04.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
21802025-02-28T11:17:04.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21812025-02-28T11:17:04.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21822025-02-28T11:17:04.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21832025-02-28T11:17:04.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21842025-02-28T11:17:04.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21852025-02-28T11:17:04.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21862025-02-28T11:17:04.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21872025-02-28T11:17:04.731ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 1 version = 2
21882025-02-28T11:17:04.731ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
21892025-02-28T11:17:04.731ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-28 11:09:19.025515 UTC dns_group = external generation = 2
21902025-02-28T11:17:04.731ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 137.824552ms iteration = 9 status = {"generation":2}
21912025-02-28T11:17:04.731ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
21922025-02-28T11:17:04.731ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 133.56434ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
21932025-02-28T11:17:04.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21942025-02-28T11:17:04.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21952025-02-28T11:17:04.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21962025-02-28T11:17:04.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21972025-02-28T11:17:04.734ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
21982025-02-28T11:17:04.734ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
21992025-02-28T11:17:04.734ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-28 11:09:18.396893 UTC dns_group = internal generation = 1
22002025-02-28T11:17:04.734ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 140.376897ms iteration = 9 status = {"generation":1}
22012025-02-28T11:17:04.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22022025-02-28T11:17:04.734ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
22032025-02-28T11:17:04.734ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22042025-02-28T11:17:04.734ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "452b405f-3a80-428a-859f-3305ca076309", "content-length": "26", "date": "Fri, 28 Feb 2025 11:17:03 GMT"} })
22052025-02-28T11:17:04.734ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22062025-02-28T11:17:04.736ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22072025-02-28T11:17:04.742ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22082025-02-28T11:17:04.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22092025-02-28T11:17:04.764ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22102025-02-28T11:17:04.764ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22112025-02-28T11:17:04.764ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 164.862021ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22122025-02-28T11:17:04.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22132025-02-28T11:17:04.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22142025-02-28T11:17:04.793ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
22152025-02-28T11:17:04.793ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 193.597767ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
22162025-02-28T11:17:04.814ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 214.899503ms iteration = 19 status = {"physical_disks_added":0}
22172025-02-28T11:17:04.824ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
22182025-02-28T11:17:04.840ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
22192025-02-28T11:17:04.840ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22202025-02-28T11:17:04.841ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b464e44d-0521-42e6-82e1-72667def3699", "content-length": "26", "date": "Fri, 28 Feb 2025 11:17:03 GMT"} })
22212025-02-28T11:17:04.841ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22222025-02-28T11:17:04.842ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
22232025-02-28T11:17:04.893ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
22242025-02-28T11:17:04.893ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1a1e84af-f055-4edc-9825-6241189894db", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22252025-02-28T11:17:04.893ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22262025-02-28T11:17:04.894ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
22272025-02-28T11:17:04.894ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22282025-02-28T11:17:04.895ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b730b9c3-2630-453a-8a2e-34441968dae2", "content-length": "26", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} })
22292025-02-28T11:17:04.895ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22302025-02-28T11:17:04.896ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2c9fb468-3012-4160-9d4d-13967528aed6", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22312025-02-28T11:17:04.896ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22322025-02-28T11:17:04.899ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22332025-02-28T11:17:04.900ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22342025-02-28T11:17:04.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 306.599827ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
22352025-02-28T11:17:04.922ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22362025-02-28T11:17:04.923ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "78173c94-28dc-4a88-ae98-69c10519013e", "content-length": "1", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} })
22372025-02-28T11:17:04.924ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22382025-02-28T11:17:04.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22392025-02-28T11:17:04.943ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22402025-02-28T11:17:04.943ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22412025-02-28T11:17:04.943ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "02461d78-50c8-4cce-a206-c820954cef7b", "content-length": "372", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} })
22422025-02-28T11:17:04.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22432025-02-28T11:17:04.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22442025-02-28T11:17:04.945ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22452025-02-28T11:17:04.946ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 352.770935ms iteration = 17 status = null
22462025-02-28T11:17:04.946ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22472025-02-28T11:17:04.946ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22482025-02-28T11:17:04.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22492025-02-28T11:17:04.961ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
22502025-02-28T11:17:04.961ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22512025-02-28T11:17:04.961ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6da00930-3d22-4658-97ad-a0c77a4b7649", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} })
22522025-02-28T11:17:04.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22532025-02-28T11:17:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22542025-02-28T11:17:04.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22552025-02-28T11:17:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22562025-02-28T11:17:04.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22572025-02-28T11:17:04.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22582025-02-28T11:17:04.970ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22592025-02-28T11:17:04.970ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22602025-02-28T11:17:04.983ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 383.490033ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
22612025-02-28T11:17:04.989ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-28T11:09:02.015184Z, time_modified: 2025-02-28T11:09:02.015184Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }) }
22622025-02-28T11:17:04.989ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 395.902829ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]}},"default_endpoint":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
22632025-02-28T11:17:04.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22642025-02-28T11:17:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22652025-02-28T11:17:04.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22662025-02-28T11:17:04.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22672025-02-28T11:17:04.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22682025-02-28T11:17:04.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22692025-02-28T11:17:04.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22702025-02-28T11:17:04.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22712025-02-28T11:17:04.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22722025-02-28T11:17:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22732025-02-28T11:17:05.062ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8e72e22c-fd92-42d1-a5bb-3d2c1c75d50b", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} })
22742025-02-28T11:17:05.064ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 464.518318ms iteration = 17 status = {}
22752025-02-28T11:17:05.076ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
22762025-02-28T11:17:05.181ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 587.623715ms iteration = 17 status = {}
22772025-02-28T11:17:05.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22782025-02-28T11:17:05.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22792025-02-28T11:17:05.239ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
22802025-02-28T11:17:05.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22812025-02-28T11:17:05.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22822025-02-28T11:17:05.249ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22832025-02-28T11:17:05.249ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc2d7fac-a03f-4e6c-bd8a-99676684fe33", "content-length": "134", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} })
22842025-02-28T11:17:05.249ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22852025-02-28T11:17:05.249ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
22862025-02-28T11:17:05.249ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22872025-02-28T11:17:05.249ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22882025-02-28T11:17:05.249ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22892025-02-28T11:17:05.249ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22902025-02-28T11:17:05.249ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22912025-02-28T11:17:05.249ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22922025-02-28T11:17:05.250ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22932025-02-28T11:17:05.250ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22942025-02-28T11:17:05.250ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
22952025-02-28T11:17:05.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22962025-02-28T11:17:05.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22972025-02-28T11:17:05.252ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22982025-02-28T11:17:05.252ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "35b21b7f-574d-4687-9ed8-af3d678ca730", "content-length": "2", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} })
22992025-02-28T11:17:05.253ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
23002025-02-28T11:17:05.253ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc4f1e4d-4d72-4180-92f1-766fcc282317", "content-length": "52", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} })
23012025-02-28T11:17:05.253ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
23022025-02-28T11:17:05.253ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
23032025-02-28T11:17:05.289ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23042025-02-28T11:17:05.289ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "39318792-3112-467f-8eef-5cc5c15a5629", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23052025-02-28T11:17:05.289ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23062025-02-28T11:17:05.290ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23072025-02-28T11:17:05.291ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "099346f0-82b3-4d3e-9922-046026d3a30d", "date": "Fri, 28 Feb 2025 11:17:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23082025-02-28T11:17:05.291ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23092025-02-28T11:17:05.292ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "179d4328-36d8-46a1-92c8-851fb6bee709", "date": "Fri, 28 Feb 2025 11:17:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23102025-02-28T11:17:05.292ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23112025-02-28T11:17:05.294ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
23122025-02-28T11:17:05.294ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 701.227227ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
23132025-02-28T11:17:05.347ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e8d2b732-89a6-4059-9233-519cf496a618", "date": "Fri, 28 Feb 2025 11:17:05 GMT"} })
23142025-02-28T11:17:05.347ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
23152025-02-28T11:17:05.347ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23162025-02-28T11:17:05.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ded4896f-8a2a-4a9d-b1fd-fca4d867c369 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23172025-02-28T11:17:05.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ded4896f-8a2a-4a9d-b1fd-fca4d867c369 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23182025-02-28T11:17:05.348ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "793d05ec-4671-4a92-9c23-5987907fc621", "content-length": "691", "date": "Fri, 28 Feb 2025 11:17:05 GMT"} })
23192025-02-28T11:17:05.348ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "30435dad-8455-47a1-93dd-3a7c836a1c54", "content-length": "682", "date": "Fri, 28 Feb 2025 11:17:05 GMT"} })
23202025-02-28T11:17:05.348ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
23212025-02-28T11:17:05.348ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
23222025-02-28T11:17:05.348ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
23232025-02-28T11:17:05.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23242025-02-28T11:17:05.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23252025-02-28T11:17:05.350ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 750.697697ms iteration = 17 status = {}
23262025-02-28T11:17:05.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ded4896f-8a2a-4a9d-b1fd-fca4d867c369 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23272025-02-28T11:17:05.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23282025-02-28T11:17:05.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23292025-02-28T11:17:05.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23302025-02-28T11:17:05.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23312025-02-28T11:17:05.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23322025-02-28T11:17:05.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23332025-02-28T11:17:05.365ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 766.22804ms iteration = 17 status = {}
23342025-02-28T11:17:06.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3f71cf4f-7212-43d2-882d-e5cccce79270 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23352025-02-28T11:17:06.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3f71cf4f-7212-43d2-882d-e5cccce79270 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23362025-02-28T11:17:06.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3f71cf4f-7212-43d2-882d-e5cccce79270 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23372025-02-28T11:17:07.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 594 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 4db98c79-3b3a-49c7-93fe-3a8e357b0830 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
23382025-02-28T11:17:07.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4dc91602-f213-4de0-baf5-278171422c56 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23392025-02-28T11:17:07.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4dc91602-f213-4de0-baf5-278171422c56 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23402025-02-28T11:17:07.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1844 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4dc91602-f213-4de0-baf5-278171422c56 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23412025-02-28T11:17:08.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 537ac38a-73ff-429b-924c-4125a0357f38 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23422025-02-28T11:17:08.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 537ac38a-73ff-429b-924c-4125a0357f38 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23432025-02-28T11:17:08.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1818 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 537ac38a-73ff-429b-924c-4125a0357f38 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23442025-02-28T11:17:09.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e7e58d16-00b1-4e5f-b7ae-45bae7ca9d29 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23452025-02-28T11:17:09.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e7e58d16-00b1-4e5f-b7ae-45bae7ca9d29 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23462025-02-28T11:17:09.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e7e58d16-00b1-4e5f-b7ae-45bae7ca9d29 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23472025-02-28T11:17:10.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fa59e45f-6d1a-4ec7-933d-9aca63f927d4 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23482025-02-28T11:17:10.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fa59e45f-6d1a-4ec7-933d-9aca63f927d4 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23492025-02-28T11:17:10.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2594 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fa59e45f-6d1a-4ec7-933d-9aca63f927d4 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23502025-02-28T11:17:11.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e60680b5-f858-4cd8-b0f5-192f41ef7ae6 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23512025-02-28T11:17:11.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e60680b5-f858-4cd8-b0f5-192f41ef7ae6 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23522025-02-28T11:17:11.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e60680b5-f858-4cd8-b0f5-192f41ef7ae6 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23532025-02-28T11:17:12.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 951c174e-5e70-44b6-9529-5f8cf3ef1356 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23542025-02-28T11:17:12.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 951c174e-5e70-44b6-9529-5f8cf3ef1356 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23552025-02-28T11:17:12.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2164 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 951c174e-5e70-44b6-9529-5f8cf3ef1356 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23562025-02-28T11:17:13.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc1497c7-ea31-43ca-8dac-55c432d0d861 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23572025-02-28T11:17:13.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc1497c7-ea31-43ca-8dac-55c432d0d861 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23582025-02-28T11:17:13.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc1497c7-ea31-43ca-8dac-55c432d0d861 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23592025-02-28T11:17:14.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e301f91f-816f-4e12-aad0-0b8b36e6388c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23602025-02-28T11:17:14.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e301f91f-816f-4e12-aad0-0b8b36e6388c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23612025-02-28T11:17:14.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e301f91f-816f-4e12-aad0-0b8b36e6388c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23622025-02-28T11:17:14.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
23632025-02-28T11:17:14.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23642025-02-28T11:17:14.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23652025-02-28T11:17:14.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
23662025-02-28T11:17:14.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23672025-02-28T11:17:14.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23682025-02-28T11:17:14.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23692025-02-28T11:17:14.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23702025-02-28T11:17:14.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23712025-02-28T11:17:14.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.421634ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23722025-02-28T11:17:14.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23732025-02-28T11:17:14.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23742025-02-28T11:17:14.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23752025-02-28T11:17:14.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23762025-02-28T11:17:14.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23772025-02-28T11:17:14.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23782025-02-28T11:17:14.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
23792025-02-28T11:17:14.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23802025-02-28T11:17:14.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23812025-02-28T11:17:14.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
23822025-02-28T11:17:14.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.724775ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
23832025-02-28T11:17:15.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9ab824d8-a586-4a59-9f2a-eb69ec65f58e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23842025-02-28T11:17:15.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9ab824d8-a586-4a59-9f2a-eb69ec65f58e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23852025-02-28T11:17:15.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2110 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9ab824d8-a586-4a59-9f2a-eb69ec65f58e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23862025-02-28T11:17:16.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4c444311-83ee-4510-8a8e-6f5f1c086acc roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23872025-02-28T11:17:16.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4c444311-83ee-4510-8a8e-6f5f1c086acc resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23882025-02-28T11:17:16.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2158 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4c444311-83ee-4510-8a8e-6f5f1c086acc response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23892025-02-28T11:17:17.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 521 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = ab0f18b1-af85-4c2f-8b7a-31a98169dac7 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
23902025-02-28T11:17:17.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 55f86222-42de-407c-85e1-e0237c55eb33 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23912025-02-28T11:17:17.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 55f86222-42de-407c-85e1-e0237c55eb33 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23922025-02-28T11:17:17.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1751 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 55f86222-42de-407c-85e1-e0237c55eb33 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23932025-02-28T11:17:18.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6a96ee3c-7d27-4afa-b3b6-6fe720246cf1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23942025-02-28T11:17:18.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6a96ee3c-7d27-4afa-b3b6-6fe720246cf1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23952025-02-28T11:17:18.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6a96ee3c-7d27-4afa-b3b6-6fe720246cf1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23962025-02-28T11:17:19.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d7942b9-d5f4-400e-a962-c20e69afe039 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23972025-02-28T11:17:19.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d7942b9-d5f4-400e-a962-c20e69afe039 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23982025-02-28T11:17:19.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2740 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d7942b9-d5f4-400e-a962-c20e69afe039 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
23992025-02-28T11:17:20.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 955df831-6703-4320-8f04-780c1a933625 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24002025-02-28T11:17:20.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 955df831-6703-4320-8f04-780c1a933625 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24012025-02-28T11:17:20.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 955df831-6703-4320-8f04-780c1a933625 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24022025-02-28T11:17:21.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9c7a3a03-4a05-4070-a028-e3abc3269d10 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24032025-02-28T11:17:21.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9c7a3a03-4a05-4070-a028-e3abc3269d10 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24042025-02-28T11:17:21.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2475 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9c7a3a03-4a05-4070-a028-e3abc3269d10 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24052025-02-28T11:17:22.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 06e0c7b3-18cd-4851-ae18-016e6c9be222 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24062025-02-28T11:17:22.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 06e0c7b3-18cd-4851-ae18-016e6c9be222 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24072025-02-28T11:17:22.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1821 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 06e0c7b3-18cd-4851-ae18-016e6c9be222 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24082025-02-28T11:17:23.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3a5d4c1c-b94a-44fa-b358-8d9323fab9b5 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24092025-02-28T11:17:23.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3a5d4c1c-b94a-44fa-b358-8d9323fab9b5 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24102025-02-28T11:17:23.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3a5d4c1c-b94a-44fa-b358-8d9323fab9b5 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24112025-02-28T11:17:24.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
24122025-02-28T11:17:24.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24132025-02-28T11:17:24.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24142025-02-28T11:17:24.599ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
24152025-02-28T11:17:24.599ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24162025-02-28T11:17:24.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24172025-02-28T11:17:24.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24182025-02-28T11:17:24.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24192025-02-28T11:17:24.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24202025-02-28T11:17:24.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.031987ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24212025-02-28T11:17:24.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24222025-02-28T11:17:24.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24232025-02-28T11:17:24.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24242025-02-28T11:17:24.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24252025-02-28T11:17:24.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24262025-02-28T11:17:24.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24272025-02-28T11:17:24.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
24282025-02-28T11:17:24.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24292025-02-28T11:17:24.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24302025-02-28T11:17:24.617ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
24312025-02-28T11:17:24.617ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.263261ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
24322025-02-28T11:17:24.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7b737af8-2049-4492-9792-26c30992db05 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24332025-02-28T11:17:24.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7b737af8-2049-4492-9792-26c30992db05 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24342025-02-28T11:17:24.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1916 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7b737af8-2049-4492-9792-26c30992db05 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24352025-02-28T11:17:25.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b4a69352-ae90-436d-b095-7c7c8955c0ad roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24362025-02-28T11:17:25.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b4a69352-ae90-436d-b095-7c7c8955c0ad resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24372025-02-28T11:17:25.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2140 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b4a69352-ae90-436d-b095-7c7c8955c0ad response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24382025-02-28T11:17:26.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29f2a0e9-bbf8-417f-a728-c6cd7efbb4c8 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24392025-02-28T11:17:26.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29f2a0e9-bbf8-417f-a728-c6cd7efbb4c8 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24402025-02-28T11:17:26.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29f2a0e9-bbf8-417f-a728-c6cd7efbb4c8 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24412025-02-28T11:17:27.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 532 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 8b225f63-5c74-447d-9fd9-304f14945d57 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
24422025-02-28T11:17:27.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5142e775-d4cf-4d1a-93b8-146657537d01 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24432025-02-28T11:17:27.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5142e775-d4cf-4d1a-93b8-146657537d01 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24442025-02-28T11:17:27.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5142e775-d4cf-4d1a-93b8-146657537d01 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24452025-02-28T11:17:28.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7d2f8ec2-5499-4c52-95c4-0c175e6b694f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24462025-02-28T11:17:28.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7d2f8ec2-5499-4c52-95c4-0c175e6b694f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24472025-02-28T11:17:28.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7d2f8ec2-5499-4c52-95c4-0c175e6b694f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24482025-02-28T11:17:29.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0384f5e4-9f21-41c9-9acd-661257b56d2c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24492025-02-28T11:17:29.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0384f5e4-9f21-41c9-9acd-661257b56d2c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24502025-02-28T11:17:29.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0384f5e4-9f21-41c9-9acd-661257b56d2c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24512025-02-28T11:17:30.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bf12cfb3-3b6a-4067-8ece-2d90545e0ecc roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24522025-02-28T11:17:30.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bf12cfb3-3b6a-4067-8ece-2d90545e0ecc resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24532025-02-28T11:17:30.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bf12cfb3-3b6a-4067-8ece-2d90545e0ecc response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24542025-02-28T11:17:31.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bffd90e2-de02-47be-bb55-00d118fe1228 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24552025-02-28T11:17:31.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bffd90e2-de02-47be-bb55-00d118fe1228 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24562025-02-28T11:17:31.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1920 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bffd90e2-de02-47be-bb55-00d118fe1228 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24572025-02-28T11:17:32.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a0df955b-5a65-49a6-b47a-d9b47ae8a1a4 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24582025-02-28T11:17:32.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a0df955b-5a65-49a6-b47a-d9b47ae8a1a4 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24592025-02-28T11:17:32.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2762 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a0df955b-5a65-49a6-b47a-d9b47ae8a1a4 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24602025-02-28T11:17:33.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 137d37b4-24be-4a06-ab50-5af9523203dd roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24612025-02-28T11:17:33.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 137d37b4-24be-4a06-ab50-5af9523203dd resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24622025-02-28T11:17:33.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 137d37b4-24be-4a06-ab50-5af9523203dd response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
24632025-02-28T11:17:34.593ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
24642025-02-28T11:17:34.593ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24652025-02-28T11:17:34.593ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
24662025-02-28T11:17:34.593ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24672025-02-28T11:17:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24682025-02-28T11:17:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24692025-02-28T11:17:34.596ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
24702025-02-28T11:17:34.596ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 147737842 } })
24712025-02-28T11:17:34.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
24722025-02-28T11:17:34.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 148185872 } })
24732025-02-28T11:17:34.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
24742025-02-28T11:17:34.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
24752025-02-28T11:17:34.599ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.289531ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24762025-02-28T11:17:34.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24772025-02-28T11:17:34.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24782025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
24792025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
24802025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24812025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24822025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
24832025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24842025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
24852025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
24862025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24872025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
24882025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24892025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24902025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
24912025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24922025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24932025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
24942025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24952025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
24962025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24972025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
24982025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24992025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
25002025-02-28T11:17:34.600ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
25012025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25022025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
25032025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
25042025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
25052025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25062025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
25072025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
25082025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25092025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
25102025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25112025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25122025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25132025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25142025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25152025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25162025-02-28T11:17:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25172025-02-28T11:17:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25182025-02-28T11:17:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25192025-02-28T11:17:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
25202025-02-28T11:17:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25212025-02-28T11:17:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25222025-02-28T11:17:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25232025-02-28T11:17:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25242025-02-28T11:17:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
25252025-02-28T11:17:34.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25262025-02-28T11:17:34.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 1.83286ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
25272025-02-28T11:17:34.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25282025-02-28T11:17:34.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25292025-02-28T11:17:34.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25302025-02-28T11:17:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25312025-02-28T11:17:34.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25322025-02-28T11:17:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25332025-02-28T11:17:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25342025-02-28T11:17:34.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25352025-02-28T11:17:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25362025-02-28T11:17:34.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25372025-02-28T11:17:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25382025-02-28T11:17:34.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25392025-02-28T11:17:34.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25402025-02-28T11:17:34.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.462169ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
25412025-02-28T11:17:34.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25422025-02-28T11:17:34.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25432025-02-28T11:17:34.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25442025-02-28T11:17:34.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25452025-02-28T11:17:34.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25462025-02-28T11:17:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25472025-02-28T11:17:34.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25482025-02-28T11:17:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25492025-02-28T11:17:34.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25502025-02-28T11:17:34.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25512025-02-28T11:17:34.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25522025-02-28T11:17:34.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25532025-02-28T11:17:34.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25542025-02-28T11:17:34.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25552025-02-28T11:17:34.613ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25562025-02-28T11:17:34.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.332956ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25572025-02-28T11:17:34.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25582025-02-28T11:17:34.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25592025-02-28T11:17:34.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
25602025-02-28T11:17:34.614ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25612025-02-28T11:17:34.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25622025-02-28T11:17:34.615ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25632025-02-28T11:17:34.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25642025-02-28T11:17:34.615ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25652025-02-28T11:17:34.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25662025-02-28T11:17:34.617ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 16.441372ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
25672025-02-28T11:17:34.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25682025-02-28T11:17:34.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25692025-02-28T11:17:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25702025-02-28T11:17:34.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25712025-02-28T11:17:34.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 169433657 } })
25722025-02-28T11:17:34.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25732025-02-28T11:17:34.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
25742025-02-28T11:17:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25752025-02-28T11:17:34.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25762025-02-28T11:17:34.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25772025-02-28T11:17:34.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25782025-02-28T11:17:34.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
25792025-02-28T11:17:34.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25802025-02-28T11:17:34.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25812025-02-28T11:17:34.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25822025-02-28T11:17:34.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25832025-02-28T11:17:34.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25842025-02-28T11:17:34.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25852025-02-28T11:17:34.635ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
25862025-02-28T11:17:34.635ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.143114ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
25872025-02-28T11:17:34.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25882025-02-28T11:17:34.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25892025-02-28T11:17:34.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25902025-02-28T11:17:34.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25912025-02-28T11:17:34.642ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25922025-02-28T11:17:34.642ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25932025-02-28T11:17:34.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25942025-02-28T11:17:34.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25952025-02-28T11:17:34.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25962025-02-28T11:17:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
25972025-02-28T11:17:34.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25982025-02-28T11:17:34.645ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25992025-02-28T11:17:34.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26002025-02-28T11:17:34.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26012025-02-28T11:17:34.647ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26022025-02-28T11:17:34.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26032025-02-28T11:17:34.648ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.690251ms iteration = 18 status = 0
26042025-02-28T11:17:34.651ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26052025-02-28T11:17:34.651ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.640604ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
26062025-02-28T11:17:34.651ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26072025-02-28T11:17:34.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26082025-02-28T11:17:34.653ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26092025-02-28T11:17:34.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
26102025-02-28T11:17:34.655ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26112025-02-28T11:17:34.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26122025-02-28T11:17:34.662ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
26132025-02-28T11:17:34.662ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 62.002608ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
26142025-02-28T11:17:34.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.168272ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26152025-02-28T11:17:34.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26162025-02-28T11:17:34.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26172025-02-28T11:17:34.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26182025-02-28T11:17:34.667ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26192025-02-28T11:17:34.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26202025-02-28T11:17:34.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26212025-02-28T11:17:34.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26222025-02-28T11:17:34.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26232025-02-28T11:17:34.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26242025-02-28T11:17:34.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26252025-02-28T11:17:34.688ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26262025-02-28T11:17:34.688ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26272025-02-28T11:17:34.688ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26282025-02-28T11:17:34.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26292025-02-28T11:17:34.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.970354ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26302025-02-28T11:17:34.692ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.058212ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
26312025-02-28T11:17:34.700ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
26322025-02-28T11:17:34.700ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26332025-02-28T11:17:34.700ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4309032-8559-4395-81c8-331565b35a8a", "content-length": "26", "date": "Fri, 28 Feb 2025 11:17:33 GMT"} })
26342025-02-28T11:17:34.700ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26352025-02-28T11:17:34.702ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
26362025-02-28T11:17:34.702ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26372025-02-28T11:17:34.702ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b8746fe-f35e-4efb-aeab-2d3278335a54", "content-length": "26", "date": "Fri, 28 Feb 2025 11:17:33 GMT"} })
26382025-02-28T11:17:34.702ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26392025-02-28T11:17:34.702ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26402025-02-28T11:17:34.704ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26412025-02-28T11:17:34.727ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26422025-02-28T11:17:34.727ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26432025-02-28T11:17:34.727ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.359697ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26442025-02-28T11:17:34.741ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 140.769224ms iteration = 20 status = {"physical_disks_added":0}
26452025-02-28T11:17:34.779ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
26462025-02-28T11:17:34.779ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26472025-02-28T11:17:34.780ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "530a6959-b801-4cc3-848a-2a3a875b47bc", "content-length": "26", "date": "Fri, 28 Feb 2025 11:17:33 GMT"} })
26482025-02-28T11:17:34.780ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26492025-02-28T11:17:34.782ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
26502025-02-28T11:17:34.845ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26512025-02-28T11:17:34.845ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26522025-02-28T11:17:34.846ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "78a2bde5-e5cb-4d98-869a-854a153c4d29", "content-length": "372", "date": "Fri, 28 Feb 2025 11:17:33 GMT"} })
26532025-02-28T11:17:34.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26542025-02-28T11:17:34.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26552025-02-28T11:17:34.848ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26562025-02-28T11:17:34.848ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc596f55-70a8-4773-88a3-624cb95f6664", "content-length": "1", "date": "Fri, 28 Feb 2025 11:17:34 GMT"} })
26572025-02-28T11:17:34.849ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26582025-02-28T11:17:34.849ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26592025-02-28T11:17:34.849ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "710bdbfd-939a-462c-9fd2-0f4df9b7564d", "content-length": "691", "date": "Fri, 28 Feb 2025 11:17:33 GMT"} })
26602025-02-28T11:17:34.849ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26612025-02-28T11:17:34.849ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26622025-02-28T11:17:34.849ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26632025-02-28T11:17:34.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26642025-02-28T11:17:34.850ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 256.967683ms iteration = 18 status = {}
26652025-02-28T11:17:34.851ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 257.424153ms iteration = 18 status = null
26662025-02-28T11:17:34.851ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 251.251032ms iteration = 18 status = {}
26672025-02-28T11:17:34.860ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
26682025-02-28T11:17:34.860ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26692025-02-28T11:17:34.860ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bc2677fd-57c5-4f90-89f2-c0616946ca27", "date": "Fri, 28 Feb 2025 11:17:33 GMT"} })
26702025-02-28T11:17:34.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26712025-02-28T11:17:34.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26722025-02-28T11:17:34.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26732025-02-28T11:17:34.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26742025-02-28T11:17:34.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26752025-02-28T11:17:34.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26762025-02-28T11:17:34.869ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26772025-02-28T11:17:34.869ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26782025-02-28T11:17:34.869ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cfc103ef-089d-4136-8aa8-a1f29fab8220", "date": "Fri, 28 Feb 2025 11:17:33 GMT"} })
26792025-02-28T11:17:34.870ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 270.064794ms iteration = 18 status = {}
26802025-02-28T11:17:34.925ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26812025-02-28T11:17:34.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26822025-02-28T11:17:34.927ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
26832025-02-28T11:17:34.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26842025-02-28T11:17:34.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26852025-02-28T11:17:34.937ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26862025-02-28T11:17:34.937ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0cb9b4a-d4f5-4bf6-b6e9-0a04f2bf97da", "content-length": "134", "date": "Fri, 28 Feb 2025 11:17:34 GMT"} })
26872025-02-28T11:17:34.937ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26882025-02-28T11:17:34.937ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
26892025-02-28T11:17:34.937ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26902025-02-28T11:17:34.937ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26912025-02-28T11:17:34.937ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26922025-02-28T11:17:34.937ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26932025-02-28T11:17:34.937ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26942025-02-28T11:17:34.937ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26952025-02-28T11:17:34.937ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26962025-02-28T11:17:34.938ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26972025-02-28T11:17:34.938ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
26982025-02-28T11:17:34.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26992025-02-28T11:17:34.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27002025-02-28T11:17:34.940ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27012025-02-28T11:17:34.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4f51de1-5263-4994-9c08-686dde763fa4", "content-length": "2", "date": "Fri, 28 Feb 2025 11:17:34 GMT"} })
27022025-02-28T11:17:34.940ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27032025-02-28T11:17:34.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "015223b8-54f5-45ce-b2bc-d29a61a6d415", "content-length": "52", "date": "Fri, 28 Feb 2025 11:17:34 GMT"} })
27042025-02-28T11:17:34.940ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
27052025-02-28T11:17:34.940ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27062025-02-28T11:17:35.034ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6771d996-f1dc-4000-bd51-ccfe783ecb53", "date": "Fri, 28 Feb 2025 11:17:35 GMT"} })
27072025-02-28T11:17:35.034ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
27082025-02-28T11:17:35.034ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27092025-02-28T11:17:35.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f345b995-63f5-4337-b8dc-e064b6d1448f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27102025-02-28T11:17:35.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f345b995-63f5-4337-b8dc-e064b6d1448f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27112025-02-28T11:17:35.034ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad632c6f-354e-4272-8806-bda19b41030a", "content-length": "682", "date": "Fri, 28 Feb 2025 11:17:35 GMT"} })
27122025-02-28T11:17:35.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27132025-02-28T11:17:35.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27142025-02-28T11:17:35.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1767 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f345b995-63f5-4337-b8dc-e064b6d1448f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27152025-02-28T11:17:35.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27162025-02-28T11:17:35.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27172025-02-28T11:17:35.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27182025-02-28T11:17:35.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27192025-02-28T11:17:35.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27202025-02-28T11:17:35.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27212025-02-28T11:17:35.051ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 451.285685ms iteration = 18 status = {}
27222025-02-28T11:17:35.212ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
27232025-02-28T11:17:35.212ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
27242025-02-28T11:17:35.242ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
27252025-02-28T11:17:35.242ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:54084
27262025-02-28T11:17:35.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54084 req_id = 848a076a-1892-4291-b7d9-ff9e0e80bbae roles = RoleSet { roles: {} } uri = /metrics/producers
27272025-02-28T11:17:35.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54084 req_id = 848a076a-1892-4291-b7d9-ff9e0e80bbae resource = Database result = Ok(()) uri = /metrics/producers
27282025-02-28T11:17:35.278ZINFOnexus: assigned collector to new producer collector_id = 59e12d21-f0a8-4840-9b1a-87533ec59eae file = nexus/src/app/oximeter.rs:76 producer_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
27292025-02-28T11:17:35.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 36391 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:54084 req_id = 848a076a-1892-4291-b7d9-ff9e0e80bbae response_code = 201 uri = /metrics/producers
27302025-02-28T11:17:35.278ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "848a076a-1892-4291-b7d9-ff9e0e80bbae", "content-length": "41", "date": "Fri, 28 Feb 2025 11:17:35 GMT"} })
27312025-02-28T11:17:35.280ZDEBGnexus (producer-registration-task): registered with nexus successfully
27322025-02-28T11:17:35.280ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
27332025-02-28T11:17:36.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2469340c-c10d-4f96-b0f0-756aba810d12 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27342025-02-28T11:17:36.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2469340c-c10d-4f96-b0f0-756aba810d12 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27352025-02-28T11:17:36.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2656 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2469340c-c10d-4f96-b0f0-756aba810d12 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27362025-02-28T11:17:37.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5a62b3fe-4668-4c72-9815-693493c071cb roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27372025-02-28T11:17:37.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5a62b3fe-4668-4c72-9815-693493c071cb resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27382025-02-28T11:17:37.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5a62b3fe-4668-4c72-9815-693493c071cb response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27392025-02-28T11:17:37.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 517 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 18daad9f-5a4e-4962-80c6-479423eb096f response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
27402025-02-28T11:17:38.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3c64db7a-c453-4bb8-8368-0c8f291ad697 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27412025-02-28T11:17:38.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3c64db7a-c453-4bb8-8368-0c8f291ad697 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27422025-02-28T11:17:38.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2794 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3c64db7a-c453-4bb8-8368-0c8f291ad697 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27432025-02-28T11:17:39.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f91f15cd-b64a-445e-a976-aafdd2b043b1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27442025-02-28T11:17:39.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f91f15cd-b64a-445e-a976-aafdd2b043b1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27452025-02-28T11:17:39.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2931 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f91f15cd-b64a-445e-a976-aafdd2b043b1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27462025-02-28T11:17:40.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4700f41d-c011-4172-989b-f231908be32a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27472025-02-28T11:17:40.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4700f41d-c011-4172-989b-f231908be32a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27482025-02-28T11:17:40.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1952 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4700f41d-c011-4172-989b-f231908be32a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27492025-02-28T11:17:41.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e65a483-aa50-4d10-bb2c-cd788cceaed8 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27502025-02-28T11:17:41.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e65a483-aa50-4d10-bb2c-cd788cceaed8 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27512025-02-28T11:17:41.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e65a483-aa50-4d10-bb2c-cd788cceaed8 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27522025-02-28T11:17:42.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d9e75122-350b-4ae3-81c4-2b3b2925e70d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27532025-02-28T11:17:42.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d9e75122-350b-4ae3-81c4-2b3b2925e70d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27542025-02-28T11:17:42.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d9e75122-350b-4ae3-81c4-2b3b2925e70d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27552025-02-28T11:17:43.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = feb9b23a-752e-4e1b-b6e7-a827a2e3ac1b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27562025-02-28T11:17:43.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = feb9b23a-752e-4e1b-b6e7-a827a2e3ac1b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27572025-02-28T11:17:43.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2195 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = feb9b23a-752e-4e1b-b6e7-a827a2e3ac1b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27582025-02-28T11:17:44.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b08e7b30-2c5d-49be-b10b-31b936b8d5fb roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27592025-02-28T11:17:44.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b08e7b30-2c5d-49be-b10b-31b936b8d5fb resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27602025-02-28T11:17:44.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b08e7b30-2c5d-49be-b10b-31b936b8d5fb response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27612025-02-28T11:17:44.598ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
27622025-02-28T11:17:44.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27632025-02-28T11:17:44.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27642025-02-28T11:17:44.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
27652025-02-28T11:17:44.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27662025-02-28T11:17:44.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27672025-02-28T11:17:44.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27682025-02-28T11:17:44.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27692025-02-28T11:17:44.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27702025-02-28T11:17:44.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27712025-02-28T11:17:44.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27722025-02-28T11:17:44.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27732025-02-28T11:17:44.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.525475ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27742025-02-28T11:17:44.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27752025-02-28T11:17:44.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27762025-02-28T11:17:44.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772025-02-28T11:17:44.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
27782025-02-28T11:17:44.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27792025-02-28T11:17:44.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27802025-02-28T11:17:44.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
27812025-02-28T11:17:44.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.761849ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
27822025-02-28T11:17:45.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a481afb2-e20d-4f69-811d-e4f4b9549502 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27832025-02-28T11:17:45.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a481afb2-e20d-4f69-811d-e4f4b9549502 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27842025-02-28T11:17:45.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a481afb2-e20d-4f69-811d-e4f4b9549502 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27852025-02-28T11:17:46.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 634410fa-6df8-4ebc-9018-c380a141b41d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27862025-02-28T11:17:46.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 634410fa-6df8-4ebc-9018-c380a141b41d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27872025-02-28T11:17:46.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 634410fa-6df8-4ebc-9018-c380a141b41d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27882025-02-28T11:17:47.068ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:41779
27892025-02-28T11:17:47.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41779 req_id = e2d4702f-68e8-464c-b55f-c20416434730 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
27902025-02-28T11:17:47.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41779 req_id = e2d4702f-68e8-464c-b55f-c20416434730 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
27912025-02-28T11:17:47.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 7288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41779 req_id = e2d4702f-68e8-464c-b55f-c20416434730 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
27922025-02-28T11:17:47.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41779 req_id = 30f15e23-869b-4945-944c-5abe18f8a7b4 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
27932025-02-28T11:17:47.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41779 req_id = 30f15e23-869b-4945-944c-5abe18f8a7b4 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
27942025-02-28T11:17:47.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2200 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41779 req_id = 30f15e23-869b-4945-944c-5abe18f8a7b4 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
27952025-02-28T11:17:47.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 597 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 6525be46-6c35-436f-b40c-392362bb652c response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
27962025-02-28T11:17:47.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8a4e092f-da2d-4a60-aea7-f5b220d7d2a0 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27972025-02-28T11:17:47.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8a4e092f-da2d-4a60-aea7-f5b220d7d2a0 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27982025-02-28T11:17:47.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1721 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8a4e092f-da2d-4a60-aea7-f5b220d7d2a0 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
27992025-02-28T11:17:48.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b08e41d0-8d44-4aa1-8842-aee0a78381f5 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28002025-02-28T11:17:48.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b08e41d0-8d44-4aa1-8842-aee0a78381f5 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28012025-02-28T11:17:48.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b08e41d0-8d44-4aa1-8842-aee0a78381f5 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28022025-02-28T11:17:49.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0e6fc50c-9e70-4af2-b2c1-047bb1affa0f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28032025-02-28T11:17:49.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0e6fc50c-9e70-4af2-b2c1-047bb1affa0f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28042025-02-28T11:17:49.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0e6fc50c-9e70-4af2-b2c1-047bb1affa0f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28052025-02-28T11:17:50.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = edd7459e-a73c-4324-91d2-1f46dade17c3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28062025-02-28T11:17:50.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = edd7459e-a73c-4324-91d2-1f46dade17c3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28072025-02-28T11:17:50.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2637 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = edd7459e-a73c-4324-91d2-1f46dade17c3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28082025-02-28T11:17:51.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bf38e13c-3df2-41f1-abef-5aeb84a3658c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28092025-02-28T11:17:51.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bf38e13c-3df2-41f1-abef-5aeb84a3658c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28102025-02-28T11:17:51.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bf38e13c-3df2-41f1-abef-5aeb84a3658c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28112025-02-28T11:17:52.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 27963a90-fa00-4a75-a6cc-bdda06b2ddf9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28122025-02-28T11:17:52.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 27963a90-fa00-4a75-a6cc-bdda06b2ddf9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28132025-02-28T11:17:52.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 27963a90-fa00-4a75-a6cc-bdda06b2ddf9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28142025-02-28T11:17:53.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ae652d8d-b106-4cb7-806e-413656c64d31 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28152025-02-28T11:17:53.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ae652d8d-b106-4cb7-806e-413656c64d31 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28162025-02-28T11:17:53.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ae652d8d-b106-4cb7-806e-413656c64d31 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28172025-02-28T11:17:54.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0882ad47-e7d3-433a-9b6a-19a05f2577ea roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28182025-02-28T11:17:54.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0882ad47-e7d3-433a-9b6a-19a05f2577ea resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28192025-02-28T11:17:54.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1933 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0882ad47-e7d3-433a-9b6a-19a05f2577ea response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28202025-02-28T11:17:54.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
28212025-02-28T11:17:54.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28222025-02-28T11:17:54.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28232025-02-28T11:17:54.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
28242025-02-28T11:17:54.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28252025-02-28T11:17:54.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28262025-02-28T11:17:54.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28272025-02-28T11:17:54.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28282025-02-28T11:17:54.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28292025-02-28T11:17:54.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.652888ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28302025-02-28T11:17:54.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28312025-02-28T11:17:54.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28322025-02-28T11:17:54.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28332025-02-28T11:17:54.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28342025-02-28T11:17:54.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28352025-02-28T11:17:54.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28362025-02-28T11:17:54.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
28372025-02-28T11:17:54.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28382025-02-28T11:17:54.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28392025-02-28T11:17:54.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
28402025-02-28T11:17:54.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.970409ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
28412025-02-28T11:17:55.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8247a13-72dd-4285-9244-d7d78ad3c6cb roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28422025-02-28T11:17:55.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8247a13-72dd-4285-9244-d7d78ad3c6cb resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28432025-02-28T11:17:55.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8247a13-72dd-4285-9244-d7d78ad3c6cb response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28442025-02-28T11:17:56.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 48532696-1847-44ce-88a7-5b14aa72c608 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28452025-02-28T11:17:56.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 48532696-1847-44ce-88a7-5b14aa72c608 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28462025-02-28T11:17:56.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 48532696-1847-44ce-88a7-5b14aa72c608 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28472025-02-28T11:17:57.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 884 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 9b840b96-3e8e-47fa-bac5-08553b8475a0 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
28482025-02-28T11:17:57.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = aa06e4d3-5335-4250-ade3-c07c02876a5c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28492025-02-28T11:17:57.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = aa06e4d3-5335-4250-ade3-c07c02876a5c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28502025-02-28T11:17:57.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = aa06e4d3-5335-4250-ade3-c07c02876a5c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28512025-02-28T11:17:58.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c0e40fdd-63d0-4d08-a848-c8c8bbf71910 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28522025-02-28T11:17:58.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c0e40fdd-63d0-4d08-a848-c8c8bbf71910 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28532025-02-28T11:17:58.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c0e40fdd-63d0-4d08-a848-c8c8bbf71910 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28542025-02-28T11:17:59.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3a837951-8409-495b-949f-31f64337f4ff roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28552025-02-28T11:17:59.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3a837951-8409-495b-949f-31f64337f4ff resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28562025-02-28T11:17:59.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1834 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3a837951-8409-495b-949f-31f64337f4ff response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28572025-02-28T11:18:00.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f66c35d5-3f24-4d92-86de-fcc489e367f9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28582025-02-28T11:18:00.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f66c35d5-3f24-4d92-86de-fcc489e367f9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28592025-02-28T11:18:00.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1928 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f66c35d5-3f24-4d92-86de-fcc489e367f9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28602025-02-28T11:18:01.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62f64575-6fa7-42bc-a181-e8158d9d76bd roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28612025-02-28T11:18:01.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62f64575-6fa7-42bc-a181-e8158d9d76bd resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28622025-02-28T11:18:01.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62f64575-6fa7-42bc-a181-e8158d9d76bd response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28632025-02-28T11:18:02.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2eda1544-7a68-4b41-aba0-29a5d4204afe roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28642025-02-28T11:18:02.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2eda1544-7a68-4b41-aba0-29a5d4204afe resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28652025-02-28T11:18:02.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2eda1544-7a68-4b41-aba0-29a5d4204afe response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28662025-02-28T11:18:03.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 306a3d19-facd-442b-a13b-d8ecffd8216c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28672025-02-28T11:18:03.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 306a3d19-facd-442b-a13b-d8ecffd8216c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28682025-02-28T11:18:03.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1923 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 306a3d19-facd-442b-a13b-d8ecffd8216c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
28692025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
28702025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28712025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
28722025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
28732025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28742025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
28752025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28762025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
28772025-02-28T11:18:04.594ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-28 11:08:04.594495436 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
28782025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
28792025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
28802025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
28812025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
28822025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
28832025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28842025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
28852025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
28862025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
28872025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28882025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28892025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
28902025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28912025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28922025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28932025-02-28T11:18:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28942025-02-28T11:18:04.595ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c58b6d59-7cb2-478f-9d27-4e70c13f0853.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("daf1508c-21c6-4c2b-91a0-3e717092a118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 145540613 } })
28952025-02-28T11:18:04.595ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cd949b0-a160-497e-a9d3-708f380c3425.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 145602915 } })
28962025-02-28T11:18:04.595ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
28972025-02-28T11:18:04.595ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 971.421\u{b5}s iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
28982025-02-28T11:18:04.595ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
28992025-02-28T11:18:04.595ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.009292ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
29002025-02-28T11:18:04.596ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
29012025-02-28T11:18:04.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29022025-02-28T11:18:04.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 147579397 } })
29032025-02-28T11:18:04.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29042025-02-28T11:18:04.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
29052025-02-28T11:18:04.597ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-28 11:08:04.594495436 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
29062025-02-28T11:18:04.597ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.172828ms iteration = 10 status = {"expiration":"2025-02-28T11:08:04.594495436Z","pruned":[]}
29072025-02-28T11:18:04.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29082025-02-28T11:18:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29092025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
29102025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29112025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29122025-02-28T11:18:04.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 149926197 } })
29132025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29142025-02-28T11:18:04.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
29152025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
29162025-02-28T11:18:04.599ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 7549b177-a582-4102-91fb-b7e6324fd615
29172025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
29182025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.35\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"7549b177-a582-4102-91fb-b7e6324fd615"}
29192025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29202025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
29212025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
29222025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
29232025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29242025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
29252025-02-28T11:18:04.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29262025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
29272025-02-28T11:18:04.600ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
29282025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29292025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
29302025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
29312025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
29322025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29332025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
29342025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29352025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
29362025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29372025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
29382025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29392025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
29402025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29412025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29422025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
29432025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
29442025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29452025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29462025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
29472025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29482025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
29492025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
29502025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
29512025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29522025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
29532025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29542025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
29552025-02-28T11:18:04.600ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29562025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29572025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
29582025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
29592025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
29602025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29612025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29622025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29632025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29642025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
29652025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29662025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29672025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29682025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29692025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29702025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29712025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29722025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
29732025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29742025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29752025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
29762025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29772025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
29782025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29792025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29802025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29812025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29822025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29832025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29842025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29852025-02-28T11:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29862025-02-28T11:18:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29872025-02-28T11:18:04.601ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29882025-02-28T11:18:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29892025-02-28T11:18:04.601ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29902025-02-28T11:18:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29912025-02-28T11:18:04.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29922025-02-28T11:18:04.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29932025-02-28T11:18:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29942025-02-28T11:18:04.602ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.61291ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29952025-02-28T11:18:04.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29962025-02-28T11:18:04.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29972025-02-28T11:18:04.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29982025-02-28T11:18:04.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29992025-02-28T11:18:04.605ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30002025-02-28T11:18:04.606ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30012025-02-28T11:18:04.606ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30022025-02-28T11:18:04.606ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30032025-02-28T11:18:04.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30042025-02-28T11:18:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30052025-02-28T11:18:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30062025-02-28T11:18:04.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30072025-02-28T11:18:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30082025-02-28T11:18:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30092025-02-28T11:18:04.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30102025-02-28T11:18:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30112025-02-28T11:18:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
30122025-02-28T11:18:04.608ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30132025-02-28T11:18:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30142025-02-28T11:18:04.609ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.478373ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
30152025-02-28T11:18:04.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.958813ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
30162025-02-28T11:18:04.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30172025-02-28T11:18:04.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30182025-02-28T11:18:04.611ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30192025-02-28T11:18:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30202025-02-28T11:18:04.612ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30212025-02-28T11:18:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30222025-02-28T11:18:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30232025-02-28T11:18:04.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30242025-02-28T11:18:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30252025-02-28T11:18:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30262025-02-28T11:18:04.613ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30272025-02-28T11:18:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30282025-02-28T11:18:04.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30292025-02-28T11:18:04.617ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30302025-02-28T11:18:04.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30312025-02-28T11:18:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30322025-02-28T11:18:04.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30332025-02-28T11:18:04.620ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30342025-02-28T11:18:04.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30352025-02-28T11:18:04.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30362025-02-28T11:18:04.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30372025-02-28T11:18:04.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30382025-02-28T11:18:04.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30392025-02-28T11:18:04.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30402025-02-28T11:18:04.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30412025-02-28T11:18:04.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30422025-02-28T11:18:04.626ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30432025-02-28T11:18:04.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30442025-02-28T11:18:04.627ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30452025-02-28T11:18:04.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30462025-02-28T11:18:04.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30472025-02-28T11:18:04.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30482025-02-28T11:18:04.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30492025-02-28T11:18:04.629ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30502025-02-28T11:18:04.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30512025-02-28T11:18:04.629ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30522025-02-28T11:18:04.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30532025-02-28T11:18:04.632ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30542025-02-28T11:18:04.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30552025-02-28T11:18:04.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30562025-02-28T11:18:04.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30572025-02-28T11:18:04.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30582025-02-28T11:18:04.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30592025-02-28T11:18:04.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30602025-02-28T11:18:04.639ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
30612025-02-28T11:18:04.639ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
30622025-02-28T11:18:04.639ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 39.637779ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
30632025-02-28T11:18:04.642ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30642025-02-28T11:18:04.642ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 42.396498ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30652025-02-28T11:18:04.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30662025-02-28T11:18:04.643ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 193788376 } })
30672025-02-28T11:18:04.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30682025-02-28T11:18:04.643ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
30692025-02-28T11:18:04.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30702025-02-28T11:18:04.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
30712025-02-28T11:18:04.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30722025-02-28T11:18:04.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30732025-02-28T11:18:04.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f621d6f6-0fd5-483d-87e4-3a708403afb3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
30742025-02-28T11:18:04.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f621d6f6-0fd5-483d-87e4-3a708403afb3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
30752025-02-28T11:18:04.654ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30762025-02-28T11:18:04.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30772025-02-28T11:18:04.657ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30782025-02-28T11:18:04.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30792025-02-28T11:18:04.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30802025-02-28T11:18:04.658ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30812025-02-28T11:18:04.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30822025-02-28T11:18:04.659ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
30832025-02-28T11:18:04.659ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
30842025-02-28T11:18:04.659ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
30852025-02-28T11:18:04.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30862025-02-28T11:18:04.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30872025-02-28T11:18:04.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
30882025-02-28T11:18:04.662ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30892025-02-28T11:18:04.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30902025-02-28T11:18:04.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30912025-02-28T11:18:04.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30922025-02-28T11:18:04.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.806943ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
30932025-02-28T11:18:04.669ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
30942025-02-28T11:18:04.669ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
30952025-02-28T11:18:04.669ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.777315ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
30962025-02-28T11:18:04.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 21425 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f621d6f6-0fd5-483d-87e4-3a708403afb3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
30972025-02-28T11:18:04.670ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.571031ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
30982025-02-28T11:18:04.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30992025-02-28T11:18:04.671ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31002025-02-28T11:18:04.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31012025-02-28T11:18:04.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 72.649516ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31022025-02-28T11:18:04.675ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31032025-02-28T11:18:04.675ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31042025-02-28T11:18:04.675ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31052025-02-28T11:18:04.675ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31062025-02-28T11:18:04.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31072025-02-28T11:18:04.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31082025-02-28T11:18:04.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31092025-02-28T11:18:04.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31102025-02-28T11:18:04.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31112025-02-28T11:18:04.677ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31122025-02-28T11:18:04.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31132025-02-28T11:18:04.678ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
31142025-02-28T11:18:04.678ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.778069ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
31152025-02-28T11:18:04.680ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
31162025-02-28T11:18:04.680ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
31172025-02-28T11:18:04.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31182025-02-28T11:18:04.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31192025-02-28T11:18:04.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31202025-02-28T11:18:04.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.849357ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31212025-02-28T11:18:04.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31222025-02-28T11:18:04.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31232025-02-28T11:18:04.685ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31242025-02-28T11:18:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31252025-02-28T11:18:04.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31262025-02-28T11:18:04.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31272025-02-28T11:18:04.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31282025-02-28T11:18:04.686ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31292025-02-28T11:18:04.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31302025-02-28T11:18:04.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31312025-02-28T11:18:04.688ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31322025-02-28T11:18:04.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31332025-02-28T11:18:04.688ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
31342025-02-28T11:18:04.688ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
31352025-02-28T11:18:04.688ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-28 11:09:18.396893 UTC dns_group = internal generation = 1
31362025-02-28T11:18:04.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 94.042554ms iteration = 10 status = {"generation":1}
31372025-02-28T11:18:04.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31382025-02-28T11:18:04.689ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 88.997946ms iteration = 5 status = {"nsuccess":5}
31392025-02-28T11:18:04.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31402025-02-28T11:18:04.689ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31412025-02-28T11:18:04.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31422025-02-28T11:18:04.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31432025-02-28T11:18:04.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31442025-02-28T11:18:04.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
31452025-02-28T11:18:04.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31462025-02-28T11:18:04.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31472025-02-28T11:18:04.696ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
31482025-02-28T11:18:04.696ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 0 version = 2
31492025-02-28T11:18:04.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31502025-02-28T11:18:04.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31512025-02-28T11:18:04.704ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
31522025-02-28T11:18:04.704ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31532025-02-28T11:18:04.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31542025-02-28T11:18:04.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31552025-02-28T11:18:04.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31562025-02-28T11:18:04.710ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31572025-02-28T11:18:04.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31582025-02-28T11:18:04.711ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 111.235753ms iteration = 21 status = {"physical_disks_added":0}
31592025-02-28T11:18:04.716ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31602025-02-28T11:18:04.716ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31612025-02-28T11:18:04.716ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31622025-02-28T11:18:04.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31632025-02-28T11:18:04.717ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
31642025-02-28T11:18:04.718ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 118.502828ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31652025-02-28T11:18:04.722ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31662025-02-28T11:18:04.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
31672025-02-28T11:18:04.723ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31682025-02-28T11:18:04.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31692025-02-28T11:18:04.740ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
31702025-02-28T11:18:04.740ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31712025-02-28T11:18:04.740ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b175369f-66fc-4d83-b788-87f2fab2d041", "content-length": "26", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} })
31722025-02-28T11:18:04.740ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31732025-02-28T11:18:04.742ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31742025-02-28T11:18:04.751ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
31752025-02-28T11:18:04.751ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31762025-02-28T11:18:04.751ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a7a26fc-bcd1-4a80-96b3-c7b7cd00ead9", "content-length": "26", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} })
31772025-02-28T11:18:04.751ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31782025-02-28T11:18:04.753ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31792025-02-28T11:18:04.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31802025-02-28T11:18:04.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31812025-02-28T11:18:04.790ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
31822025-02-28T11:18:04.790ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31832025-02-28T11:18:04.791ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3947b0a9-4031-4c8b-b7d1-c6565dedd77b", "content-length": "26", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} })
31842025-02-28T11:18:04.791ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31852025-02-28T11:18:04.793ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
31862025-02-28T11:18:04.850ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
31872025-02-28T11:18:04.851ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2f715410-dc6b-4fc1-b305-3dc1f070ccc0", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31882025-02-28T11:18:04.851ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31892025-02-28T11:18:04.852ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1eb592d3-9b67-4660-9f04-bc8ec57c7028", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31902025-02-28T11:18:04.852ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31912025-02-28T11:18:04.854ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31922025-02-28T11:18:04.854ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 260.109021ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
31932025-02-28T11:18:04.869ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31942025-02-28T11:18:04.869ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31952025-02-28T11:18:04.870ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ba6a9a4-7d6c-4a7f-806f-1ac15e2512ed", "content-length": "372", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} })
31962025-02-28T11:18:04.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31972025-02-28T11:18:04.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31982025-02-28T11:18:04.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31992025-02-28T11:18:04.871ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 271.633348ms iteration = 19 status = 0
32002025-02-28T11:18:04.872ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32012025-02-28T11:18:04.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32022025-02-28T11:18:04.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32032025-02-28T11:18:04.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32042025-02-28T11:18:04.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32052025-02-28T11:18:04.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32062025-02-28T11:18:04.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32072025-02-28T11:18:04.878ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 1 version = 2
32082025-02-28T11:18:04.878ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32092025-02-28T11:18:04.878ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-28 11:09:19.025515 UTC dns_group = external generation = 2
32102025-02-28T11:18:04.878ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 284.38988ms iteration = 10 status = {"generation":2}
32112025-02-28T11:18:04.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32122025-02-28T11:18:04.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32132025-02-28T11:18:04.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32142025-02-28T11:18:04.884ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 289.837368ms iteration = 19 status = {}
32152025-02-28T11:18:04.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32162025-02-28T11:18:04.884ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32172025-02-28T11:18:04.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32182025-02-28T11:18:04.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32192025-02-28T11:18:04.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32202025-02-28T11:18:04.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32212025-02-28T11:18:04.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32222025-02-28T11:18:04.890ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
32232025-02-28T11:18:04.890ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32242025-02-28T11:18:04.890ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dac2e85b-cceb-45e4-a7b1-9ef99fa037e4", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} })
32252025-02-28T11:18:04.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32262025-02-28T11:18:04.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32272025-02-28T11:18:04.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32282025-02-28T11:18:04.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32292025-02-28T11:18:04.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32302025-02-28T11:18:04.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32312025-02-28T11:18:04.899ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32322025-02-28T11:18:04.899ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32332025-02-28T11:18:04.900ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32342025-02-28T11:18:04.900ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbf2ec6c-e85c-4340-b171-c624fd0261c1", "content-length": "1", "date": "Fri, 28 Feb 2025 11:18:03 GMT"} })
32352025-02-28T11:18:04.900ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f86198f3-fe97-4f6c-a29b-a146445896c3", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} })
32362025-02-28T11:18:04.903ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 303.432309ms iteration = 19 status = {}
32372025-02-28T11:18:04.903ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32382025-02-28T11:18:04.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32392025-02-28T11:18:04.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 304.42704ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
32402025-02-28T11:18:04.904ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
32412025-02-28T11:18:04.904ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 304.799038ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
32422025-02-28T11:18:04.906ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 311.630514ms iteration = 19 status = null
32432025-02-28T11:18:04.910ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32442025-02-28T11:18:04.910ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32452025-02-28T11:18:04.910ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 310.342937ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32462025-02-28T11:18:04.915ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-28T11:09:02.015184Z, time_modified: 2025-02-28T11:09:02.015184Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }) }
32472025-02-28T11:18:04.915ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 320.870822ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]}},"default_endpoint":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
32482025-02-28T11:18:04.931ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
32492025-02-28T11:18:04.931ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 331.771305ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
32502025-02-28T11:18:04.933ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
32512025-02-28T11:18:04.993ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32522025-02-28T11:18:04.993ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4cf85d1-880b-4e20-931e-87e07302917d", "content-length": "691", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} })
32532025-02-28T11:18:04.993ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32542025-02-28T11:18:04.993ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32552025-02-28T11:18:04.993ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32562025-02-28T11:18:04.994ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 394.437967ms iteration = 19 status = {}
32572025-02-28T11:18:05.084ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32582025-02-28T11:18:05.085ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f6135eb2-9ef4-4362-ba3f-f06f1e251911", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32592025-02-28T11:18:05.085ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32602025-02-28T11:18:05.086ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b2b088bd-189d-4703-8d16-7e3e05b6189f", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32612025-02-28T11:18:05.086ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32622025-02-28T11:18:05.088ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d6396fae-0583-42dc-8330-417d6380ea1c", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32632025-02-28T11:18:05.088ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32642025-02-28T11:18:05.089ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
32652025-02-28T11:18:05.090ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 495.41401ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
32662025-02-28T11:18:05.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32672025-02-28T11:18:05.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32682025-02-28T11:18:05.131ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
32692025-02-28T11:18:05.131ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32702025-02-28T11:18:05.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32712025-02-28T11:18:05.139ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32722025-02-28T11:18:05.140ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2020a7d6-b583-4272-bc62-fbcc055de32a", "content-length": "134", "date": "Fri, 28 Feb 2025 11:18:05 GMT"} })
32732025-02-28T11:18:05.140ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32742025-02-28T11:18:05.140ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
32752025-02-28T11:18:05.140ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32762025-02-28T11:18:05.140ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32772025-02-28T11:18:05.140ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32782025-02-28T11:18:05.140ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32792025-02-28T11:18:05.140ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32802025-02-28T11:18:05.140ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32812025-02-28T11:18:05.140ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32822025-02-28T11:18:05.140ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32832025-02-28T11:18:05.140ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
32842025-02-28T11:18:05.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32852025-02-28T11:18:05.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32862025-02-28T11:18:05.143ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32872025-02-28T11:18:05.143ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fbf8937-e7ed-4f48-9284-99fbf2286dba", "content-length": "2", "date": "Fri, 28 Feb 2025 11:18:05 GMT"} })
32882025-02-28T11:18:05.143ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32892025-02-28T11:18:05.143ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad34a184-51e1-4f9a-bb1a-2ac94742b610", "content-length": "52", "date": "Fri, 28 Feb 2025 11:18:05 GMT"} })
32902025-02-28T11:18:05.143ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
32912025-02-28T11:18:05.143ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32922025-02-28T11:18:05.230ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8193dac4-f52c-4d4e-ac46-51660b65db45", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} })
32932025-02-28T11:18:05.230ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
32942025-02-28T11:18:05.230ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32952025-02-28T11:18:05.230ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b607b15-419a-4e87-aea8-59ee841a5a6d", "content-length": "682", "date": "Fri, 28 Feb 2025 11:18:04 GMT"} })
32962025-02-28T11:18:05.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32972025-02-28T11:18:05.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32982025-02-28T11:18:05.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32992025-02-28T11:18:05.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33002025-02-28T11:18:05.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33012025-02-28T11:18:05.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33022025-02-28T11:18:05.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33032025-02-28T11:18:05.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33042025-02-28T11:18:05.246ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 645.987914ms iteration = 19 status = {}
33052025-02-28T11:18:05.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ac380b00-afce-47f1-8ae1-e9371a073472 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33062025-02-28T11:18:05.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ac380b00-afce-47f1-8ae1-e9371a073472 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33072025-02-28T11:18:05.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ac380b00-afce-47f1-8ae1-e9371a073472 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33082025-02-28T11:18:06.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 84adae00-cbe3-452f-90aa-a59117260574 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33092025-02-28T11:18:06.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 84adae00-cbe3-452f-90aa-a59117260574 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33102025-02-28T11:18:06.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1880 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 84adae00-cbe3-452f-90aa-a59117260574 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33112025-02-28T11:18:07.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 611 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = c497c577-ad63-4c83-b0c9-cf40416a1f20 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
33122025-02-28T11:18:07.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b5ee3077-a266-4127-8375-f854c1e57a28 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33132025-02-28T11:18:07.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b5ee3077-a266-4127-8375-f854c1e57a28 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33142025-02-28T11:18:07.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b5ee3077-a266-4127-8375-f854c1e57a28 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33152025-02-28T11:18:08.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 65f9e8cd-7f9d-472e-9421-060cdeb9a96c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33162025-02-28T11:18:08.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 65f9e8cd-7f9d-472e-9421-060cdeb9a96c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33172025-02-28T11:18:08.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1885 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 65f9e8cd-7f9d-472e-9421-060cdeb9a96c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33182025-02-28T11:18:09.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 80220bbc-1af0-4fff-8671-375e3091d74e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33192025-02-28T11:18:09.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 80220bbc-1af0-4fff-8671-375e3091d74e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33202025-02-28T11:18:09.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 80220bbc-1af0-4fff-8671-375e3091d74e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33212025-02-28T11:18:10.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 667788d0-de13-4802-b2ef-feddbb49fc0d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33222025-02-28T11:18:10.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 667788d0-de13-4802-b2ef-feddbb49fc0d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33232025-02-28T11:18:10.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 667788d0-de13-4802-b2ef-feddbb49fc0d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33242025-02-28T11:18:11.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e2f8df19-30b4-48ad-a1c1-141817b1770a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33252025-02-28T11:18:11.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e2f8df19-30b4-48ad-a1c1-141817b1770a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33262025-02-28T11:18:11.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e2f8df19-30b4-48ad-a1c1-141817b1770a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33272025-02-28T11:18:12.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ce24331a-f078-4760-bb71-fb676b4bbaa3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33282025-02-28T11:18:12.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ce24331a-f078-4760-bb71-fb676b4bbaa3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33292025-02-28T11:18:12.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2732 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ce24331a-f078-4760-bb71-fb676b4bbaa3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33302025-02-28T11:18:13.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8dbb564-d928-4c53-82c5-5e1490e67679 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33312025-02-28T11:18:13.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8dbb564-d928-4c53-82c5-5e1490e67679 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33322025-02-28T11:18:13.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8dbb564-d928-4c53-82c5-5e1490e67679 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33332025-02-28T11:18:14.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
33342025-02-28T11:18:14.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33352025-02-28T11:18:14.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33362025-02-28T11:18:14.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
33372025-02-28T11:18:14.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33382025-02-28T11:18:14.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33392025-02-28T11:18:14.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33402025-02-28T11:18:14.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33412025-02-28T11:18:14.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33422025-02-28T11:18:14.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.26707ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33432025-02-28T11:18:14.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33442025-02-28T11:18:14.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33452025-02-28T11:18:14.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33462025-02-28T11:18:14.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33472025-02-28T11:18:14.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33482025-02-28T11:18:14.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33492025-02-28T11:18:14.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
33502025-02-28T11:18:14.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33512025-02-28T11:18:14.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33522025-02-28T11:18:14.618ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
33532025-02-28T11:18:14.618ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.69267ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
33542025-02-28T11:18:14.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3d4ec2eb-70f6-49a0-887f-ca4651cca515 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33552025-02-28T11:18:14.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3d4ec2eb-70f6-49a0-887f-ca4651cca515 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33562025-02-28T11:18:14.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1967 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3d4ec2eb-70f6-49a0-887f-ca4651cca515 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33572025-02-28T11:18:15.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ebbb731a-2819-49af-9696-37e20c58fd26 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33582025-02-28T11:18:15.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ebbb731a-2819-49af-9696-37e20c58fd26 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33592025-02-28T11:18:15.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ebbb731a-2819-49af-9696-37e20c58fd26 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33602025-02-28T11:18:16.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6521de71-c6f7-4edd-8d8f-65cbc4fe6e02 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33612025-02-28T11:18:16.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6521de71-c6f7-4edd-8d8f-65cbc4fe6e02 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33622025-02-28T11:18:16.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6521de71-c6f7-4edd-8d8f-65cbc4fe6e02 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33632025-02-28T11:18:17.082ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 542 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 6793b309-d47d-42e4-bc59-f8b4b89d9961 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
33642025-02-28T11:18:17.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a8cc54df-80db-4fd5-a2d2-9c2c1deda4cc roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33652025-02-28T11:18:17.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a8cc54df-80db-4fd5-a2d2-9c2c1deda4cc resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33662025-02-28T11:18:17.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1918 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a8cc54df-80db-4fd5-a2d2-9c2c1deda4cc response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33672025-02-28T11:18:18.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fd75d00b-bf90-4aa4-aae9-daa10bcfa5dc roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33682025-02-28T11:18:18.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fd75d00b-bf90-4aa4-aae9-daa10bcfa5dc resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33692025-02-28T11:18:18.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fd75d00b-bf90-4aa4-aae9-daa10bcfa5dc response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33702025-02-28T11:18:19.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 599777e3-c421-46aa-8f78-8b4ee5764fb2 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33712025-02-28T11:18:19.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 599777e3-c421-46aa-8f78-8b4ee5764fb2 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33722025-02-28T11:18:19.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3044 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 599777e3-c421-46aa-8f78-8b4ee5764fb2 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33732025-02-28T11:18:21.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 91cf2bde-46ca-4352-9546-549fed5da82f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33742025-02-28T11:18:21.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 91cf2bde-46ca-4352-9546-549fed5da82f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33752025-02-28T11:18:21.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2453 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 91cf2bde-46ca-4352-9546-549fed5da82f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33762025-02-28T11:18:22.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 98b45048-01de-4546-b3a0-037ad54cef70 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33772025-02-28T11:18:22.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 98b45048-01de-4546-b3a0-037ad54cef70 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33782025-02-28T11:18:22.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 98b45048-01de-4546-b3a0-037ad54cef70 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33792025-02-28T11:18:23.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d9430ff5-3243-45c7-87e5-3245611c19a8 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33802025-02-28T11:18:23.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d9430ff5-3243-45c7-87e5-3245611c19a8 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33812025-02-28T11:18:23.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1857 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d9430ff5-3243-45c7-87e5-3245611c19a8 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33822025-02-28T11:18:24.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1adcf64a-3e09-4c3a-ae5e-32918f10f5fa roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33832025-02-28T11:18:24.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1adcf64a-3e09-4c3a-ae5e-32918f10f5fa resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33842025-02-28T11:18:24.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1adcf64a-3e09-4c3a-ae5e-32918f10f5fa response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
33852025-02-28T11:18:24.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
33862025-02-28T11:18:24.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33872025-02-28T11:18:24.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33882025-02-28T11:18:24.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
33892025-02-28T11:18:24.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33902025-02-28T11:18:24.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33912025-02-28T11:18:24.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33922025-02-28T11:18:24.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33932025-02-28T11:18:24.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33942025-02-28T11:18:24.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33952025-02-28T11:18:24.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33962025-02-28T11:18:24.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33972025-02-28T11:18:24.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.599617ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33982025-02-28T11:18:24.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33992025-02-28T11:18:24.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34002025-02-28T11:18:24.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34012025-02-28T11:18:24.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
34022025-02-28T11:18:24.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34032025-02-28T11:18:24.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34042025-02-28T11:18:24.616ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
34052025-02-28T11:18:24.616ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.349661ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
34062025-02-28T11:18:25.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 99cacd15-4976-4665-8461-f52b06848500 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34072025-02-28T11:18:25.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 99cacd15-4976-4665-8461-f52b06848500 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34082025-02-28T11:18:25.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1852 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 99cacd15-4976-4665-8461-f52b06848500 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34092025-02-28T11:18:26.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 237238c7-54ce-4d20-a00b-9cac01fa2f64 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34102025-02-28T11:18:26.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 237238c7-54ce-4d20-a00b-9cac01fa2f64 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34112025-02-28T11:18:26.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2495 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 237238c7-54ce-4d20-a00b-9cac01fa2f64 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34122025-02-28T11:18:27.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 849 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 9dba6c32-eb9a-43cc-a5e1-14aca65d08f3 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
34132025-02-28T11:18:27.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 83a0c3b2-14b9-43bc-8f20-fbbc4ef0c8a4 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34142025-02-28T11:18:27.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 83a0c3b2-14b9-43bc-8f20-fbbc4ef0c8a4 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34152025-02-28T11:18:27.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1855 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 83a0c3b2-14b9-43bc-8f20-fbbc4ef0c8a4 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34162025-02-28T11:18:28.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d54b2ef-52b0-49eb-b51c-fc432b0c941d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34172025-02-28T11:18:28.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d54b2ef-52b0-49eb-b51c-fc432b0c941d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34182025-02-28T11:18:28.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2651 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d54b2ef-52b0-49eb-b51c-fc432b0c941d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34192025-02-28T11:18:29.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7568eaa6-70d6-47f7-89e2-e5ccb20513aa roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34202025-02-28T11:18:29.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7568eaa6-70d6-47f7-89e2-e5ccb20513aa resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34212025-02-28T11:18:29.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7568eaa6-70d6-47f7-89e2-e5ccb20513aa response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34222025-02-28T11:18:30.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 793b58cd-10ad-4e28-9dcb-d6ad7770b748 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34232025-02-28T11:18:30.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 793b58cd-10ad-4e28-9dcb-d6ad7770b748 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34242025-02-28T11:18:30.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 793b58cd-10ad-4e28-9dcb-d6ad7770b748 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34252025-02-28T11:18:31.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 94b65cb3-f771-4592-aed4-59aa5dce6e0b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34262025-02-28T11:18:31.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 94b65cb3-f771-4592-aed4-59aa5dce6e0b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34272025-02-28T11:18:31.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 94b65cb3-f771-4592-aed4-59aa5dce6e0b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34282025-02-28T11:18:32.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cde3a63f-429f-4e61-bc1b-a64cd5aa4d67 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34292025-02-28T11:18:32.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cde3a63f-429f-4e61-bc1b-a64cd5aa4d67 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34302025-02-28T11:18:32.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cde3a63f-429f-4e61-bc1b-a64cd5aa4d67 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34312025-02-28T11:18:33.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7e94b57e-0614-4171-81e8-bb5567804713 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34322025-02-28T11:18:33.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7e94b57e-0614-4171-81e8-bb5567804713 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34332025-02-28T11:18:33.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7e94b57e-0614-4171-81e8-bb5567804713 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34342025-02-28T11:18:34.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8a519eeb-e87d-451f-befa-2bc4d08ea732 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34352025-02-28T11:18:34.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8a519eeb-e87d-451f-befa-2bc4d08ea732 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34362025-02-28T11:18:34.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8a519eeb-e87d-451f-befa-2bc4d08ea732 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
34372025-02-28T11:18:34.594ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
34382025-02-28T11:18:34.594ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34392025-02-28T11:18:34.594ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
34402025-02-28T11:18:34.594ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34412025-02-28T11:18:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34422025-02-28T11:18:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34432025-02-28T11:18:34.596ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
34442025-02-28T11:18:34.596ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 147183287 } })
34452025-02-28T11:18:34.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
34462025-02-28T11:18:34.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 147882273 } })
34472025-02-28T11:18:34.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
34482025-02-28T11:18:34.598ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.440443ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34492025-02-28T11:18:34.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
34502025-02-28T11:18:34.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34512025-02-28T11:18:34.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34522025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
34532025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
34542025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34552025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34562025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
34572025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34582025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
34592025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
34602025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34612025-02-28T11:18:34.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34622025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34632025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
34642025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
34652025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34662025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34672025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
34682025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
34692025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
34702025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
34712025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
34722025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
34732025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
34742025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
34752025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34762025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
34772025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34782025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
34792025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34802025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
34812025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34822025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34832025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
34842025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34852025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34862025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34872025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34882025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34892025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34902025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34912025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34922025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
34932025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34942025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34952025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34962025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34972025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34982025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34992025-02-28T11:18:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35002025-02-28T11:18:34.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35012025-02-28T11:18:34.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35022025-02-28T11:18:34.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35032025-02-28T11:18:34.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35042025-02-28T11:18:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35052025-02-28T11:18:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35062025-02-28T11:18:34.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35072025-02-28T11:18:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35082025-02-28T11:18:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35092025-02-28T11:18:34.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35102025-02-28T11:18:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35112025-02-28T11:18:34.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35122025-02-28T11:18:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35132025-02-28T11:18:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35142025-02-28T11:18:34.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35152025-02-28T11:18:34.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35162025-02-28T11:18:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35172025-02-28T11:18:34.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35182025-02-28T11:18:34.607ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35192025-02-28T11:18:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35202025-02-28T11:18:34.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35212025-02-28T11:18:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35222025-02-28T11:18:34.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35232025-02-28T11:18:34.609ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35242025-02-28T11:18:34.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35252025-02-28T11:18:34.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.108085ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
35262025-02-28T11:18:34.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35272025-02-28T11:18:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35282025-02-28T11:18:34.610ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 9.830701ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
35292025-02-28T11:18:34.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35302025-02-28T11:18:34.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 11.16637ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35312025-02-28T11:18:34.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.419084ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
35322025-02-28T11:18:34.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35332025-02-28T11:18:34.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35342025-02-28T11:18:34.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 164282264 } })
35352025-02-28T11:18:34.614ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
35362025-02-28T11:18:34.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35372025-02-28T11:18:34.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35382025-02-28T11:18:34.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35392025-02-28T11:18:34.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35402025-02-28T11:18:34.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35412025-02-28T11:18:34.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35422025-02-28T11:18:34.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35432025-02-28T11:18:34.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35442025-02-28T11:18:34.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35452025-02-28T11:18:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35462025-02-28T11:18:34.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
35472025-02-28T11:18:34.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35482025-02-28T11:18:34.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35492025-02-28T11:18:34.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35502025-02-28T11:18:34.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35512025-02-28T11:18:34.622ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35522025-02-28T11:18:34.622ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.051251ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35532025-02-28T11:18:34.637ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
35542025-02-28T11:18:34.637ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.672658ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
35552025-02-28T11:18:34.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35562025-02-28T11:18:34.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35572025-02-28T11:18:34.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35582025-02-28T11:18:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35592025-02-28T11:18:34.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 45.155977ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35602025-02-28T11:18:34.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35612025-02-28T11:18:34.647ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35622025-02-28T11:18:34.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35632025-02-28T11:18:34.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35642025-02-28T11:18:34.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35652025-02-28T11:18:34.653ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35662025-02-28T11:18:34.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35672025-02-28T11:18:34.653ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35682025-02-28T11:18:34.653ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35692025-02-28T11:18:34.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35702025-02-28T11:18:34.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35712025-02-28T11:18:34.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 53.786422ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
35722025-02-28T11:18:34.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
35732025-02-28T11:18:34.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35742025-02-28T11:18:34.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35752025-02-28T11:18:34.658ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.9645ms iteration = 20 status = 0
35762025-02-28T11:18:34.658ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35772025-02-28T11:18:34.658ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35782025-02-28T11:18:34.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35792025-02-28T11:18:34.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35802025-02-28T11:18:34.659ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35812025-02-28T11:18:34.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35822025-02-28T11:18:34.661ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35832025-02-28T11:18:34.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35842025-02-28T11:18:34.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35852025-02-28T11:18:34.663ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35862025-02-28T11:18:34.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35872025-02-28T11:18:34.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35882025-02-28T11:18:34.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35892025-02-28T11:18:34.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35902025-02-28T11:18:34.665ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
35912025-02-28T11:18:34.665ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 64.054382ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
35922025-02-28T11:18:34.672ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
35932025-02-28T11:18:34.672ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35942025-02-28T11:18:34.673ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f2b2b05-e6cd-4f84-92fa-815ce1db7ef0", "content-length": "26", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
35952025-02-28T11:18:34.673ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35962025-02-28T11:18:34.674ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
35972025-02-28T11:18:34.674ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35982025-02-28T11:18:34.674ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29ee8a93-c1fb-4a44-b362-4760e9e2f0ab", "content-length": "26", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
35992025-02-28T11:18:34.674ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36002025-02-28T11:18:34.675ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36012025-02-28T11:18:34.676ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36022025-02-28T11:18:34.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.216113ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36032025-02-28T11:18:34.696ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
36042025-02-28T11:18:34.696ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36052025-02-28T11:18:34.697ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99a0d141-5c3e-4c69-aeb0-2519b6060dec", "content-length": "26", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
36062025-02-28T11:18:34.697ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36072025-02-28T11:18:34.698ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36082025-02-28T11:18:34.698ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36092025-02-28T11:18:34.698ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 97.236972ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36102025-02-28T11:18:34.698ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
36112025-02-28T11:18:34.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36122025-02-28T11:18:34.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36132025-02-28T11:18:34.766ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 164.995713ms iteration = 22 status = {"physical_disks_added":0}
36142025-02-28T11:18:34.780ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36152025-02-28T11:18:34.780ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "08006853-d00f-4ed5-9973-4125cb09e7d1", "content-length": "1", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
36162025-02-28T11:18:34.782ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36172025-02-28T11:18:34.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36182025-02-28T11:18:34.785ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 190.829087ms iteration = 20 status = {}
36192025-02-28T11:18:34.796ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36202025-02-28T11:18:34.796ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36212025-02-28T11:18:34.798ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 203.929517ms iteration = 20 status = null
36222025-02-28T11:18:34.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36232025-02-28T11:18:34.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36242025-02-28T11:18:34.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36252025-02-28T11:18:34.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36262025-02-28T11:18:34.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36272025-02-28T11:18:34.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36282025-02-28T11:18:34.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36292025-02-28T11:18:34.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36302025-02-28T11:18:34.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36312025-02-28T11:18:34.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36322025-02-28T11:18:34.854ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36332025-02-28T11:18:34.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36342025-02-28T11:18:34.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36352025-02-28T11:18:34.866ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
36362025-02-28T11:18:34.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36372025-02-28T11:18:34.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36382025-02-28T11:18:34.876ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36392025-02-28T11:18:34.876ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6862923e-c499-4dfa-a7cc-fe03205a162d", "content-length": "134", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
36402025-02-28T11:18:34.876ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36412025-02-28T11:18:34.876ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
36422025-02-28T11:18:34.877ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36432025-02-28T11:18:34.877ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36442025-02-28T11:18:34.877ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36452025-02-28T11:18:34.877ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36462025-02-28T11:18:34.877ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36472025-02-28T11:18:34.877ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36482025-02-28T11:18:34.877ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36492025-02-28T11:18:34.877ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36502025-02-28T11:18:34.877ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
36512025-02-28T11:18:34.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36522025-02-28T11:18:34.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36532025-02-28T11:18:34.878ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c851ca1d-23ff-466c-80dd-f92b5f446747", "content-length": "691", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
36542025-02-28T11:18:34.878ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
36552025-02-28T11:18:34.879ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
36562025-02-28T11:18:34.879ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
36572025-02-28T11:18:34.879ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "67959eaf-67fd-4c02-9eb1-f3872ade2059", "content-length": "372", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
36582025-02-28T11:18:34.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36592025-02-28T11:18:34.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36602025-02-28T11:18:34.879ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36612025-02-28T11:18:34.879ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "082e1c62-137c-41c9-a617-950daf5783e8", "content-length": "2", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
36622025-02-28T11:18:34.879ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36632025-02-28T11:18:34.879ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff3543bb-6ae2-401e-bbc5-332ae7773ef4", "content-length": "52", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
36642025-02-28T11:18:34.879ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
36652025-02-28T11:18:34.879ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36662025-02-28T11:18:34.881ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 280.337244ms iteration = 20 status = {}
36672025-02-28T11:18:34.894ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
36682025-02-28T11:18:34.894ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36692025-02-28T11:18:34.979ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f4668ade-a290-4a0d-8384-f137a7581246", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
36702025-02-28T11:18:34.979ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
36712025-02-28T11:18:34.979ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36722025-02-28T11:18:34.979ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3eeb691-6f4f-4449-94fa-673bdfdd439f", "content-length": "682", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
36732025-02-28T11:18:34.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36742025-02-28T11:18:34.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36752025-02-28T11:18:34.979ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "15a8d37f-ec2b-4180-98fc-a1d564bde1f3", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
36762025-02-28T11:18:34.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36772025-02-28T11:18:34.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36782025-02-28T11:18:34.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36792025-02-28T11:18:34.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36802025-02-28T11:18:34.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36812025-02-28T11:18:34.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36822025-02-28T11:18:34.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36832025-02-28T11:18:34.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36842025-02-28T11:18:34.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36852025-02-28T11:18:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36862025-02-28T11:18:34.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36872025-02-28T11:18:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36882025-02-28T11:18:34.988ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36892025-02-28T11:18:34.988ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36902025-02-28T11:18:34.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ba2825d5-39de-4e9a-b29e-d3264b1cf944", "date": "Fri, 28 Feb 2025 11:18:34 GMT"} })
36912025-02-28T11:18:34.991ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 390.418861ms iteration = 20 status = {}
36922025-02-28T11:18:34.995ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 394.206392ms iteration = 20 status = {}
36932025-02-28T11:18:35.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ce1bb063-b9ec-4266-b545-40cc6ad77d50 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
36942025-02-28T11:18:35.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ce1bb063-b9ec-4266-b545-40cc6ad77d50 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
36952025-02-28T11:18:35.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ce1bb063-b9ec-4266-b545-40cc6ad77d50 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
36962025-02-28T11:18:36.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 70f1b0e0-d9e1-49bc-bba3-4b1e4da3e70c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
36972025-02-28T11:18:36.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 70f1b0e0-d9e1-49bc-bba3-4b1e4da3e70c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
36982025-02-28T11:18:36.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1968 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 70f1b0e0-d9e1-49bc-bba3-4b1e4da3e70c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
36992025-02-28T11:18:37.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 563 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = ceab8475-d09b-440d-89ea-d4e792c33b2b response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
37002025-02-28T11:18:37.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1dc6a363-adfb-465a-9abf-cdc2a4eec150 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37012025-02-28T11:18:37.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1dc6a363-adfb-465a-9abf-cdc2a4eec150 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37022025-02-28T11:18:37.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1dc6a363-adfb-465a-9abf-cdc2a4eec150 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37032025-02-28T11:18:38.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e889cf0-4dd6-42f2-9387-d08dff33fe9c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37042025-02-28T11:18:38.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e889cf0-4dd6-42f2-9387-d08dff33fe9c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37052025-02-28T11:18:38.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e889cf0-4dd6-42f2-9387-d08dff33fe9c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37062025-02-28T11:18:39.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = adb8340b-37d1-4d7d-ace3-0b8ebe4318cf roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37072025-02-28T11:18:39.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = adb8340b-37d1-4d7d-ace3-0b8ebe4318cf resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37082025-02-28T11:18:39.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2626 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = adb8340b-37d1-4d7d-ace3-0b8ebe4318cf response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37092025-02-28T11:18:40.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a1a4c4e7-af9f-4b6d-823e-b89d96da5708 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37102025-02-28T11:18:40.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a1a4c4e7-af9f-4b6d-823e-b89d96da5708 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37112025-02-28T11:18:40.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a1a4c4e7-af9f-4b6d-823e-b89d96da5708 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37122025-02-28T11:18:41.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 17cbffda-c3ce-456f-9f4c-bee75adcd67b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37132025-02-28T11:18:41.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 17cbffda-c3ce-456f-9f4c-bee75adcd67b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37142025-02-28T11:18:41.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1903 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 17cbffda-c3ce-456f-9f4c-bee75adcd67b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37152025-02-28T11:18:42.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 54c76e82-99b1-4320-aefa-7a15998ee08d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37162025-02-28T11:18:42.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 54c76e82-99b1-4320-aefa-7a15998ee08d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37172025-02-28T11:18:42.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2128 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 54c76e82-99b1-4320-aefa-7a15998ee08d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37182025-02-28T11:18:43.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5ed92529-360a-46ca-afc5-7157316e6929 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37192025-02-28T11:18:43.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5ed92529-360a-46ca-afc5-7157316e6929 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37202025-02-28T11:18:43.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5ed92529-360a-46ca-afc5-7157316e6929 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37212025-02-28T11:18:44.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8f2b4fc-863b-4535-a200-8fd07868f64b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37222025-02-28T11:18:44.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8f2b4fc-863b-4535-a200-8fd07868f64b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37232025-02-28T11:18:44.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2158 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f8f2b4fc-863b-4535-a200-8fd07868f64b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37242025-02-28T11:18:44.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
37252025-02-28T11:18:44.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37262025-02-28T11:18:44.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37272025-02-28T11:18:44.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
37282025-02-28T11:18:44.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37292025-02-28T11:18:44.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37302025-02-28T11:18:44.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37312025-02-28T11:18:44.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37322025-02-28T11:18:44.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37332025-02-28T11:18:44.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.015436ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37342025-02-28T11:18:44.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37352025-02-28T11:18:44.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37362025-02-28T11:18:44.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37372025-02-28T11:18:44.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37382025-02-28T11:18:44.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37392025-02-28T11:18:44.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37402025-02-28T11:18:44.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
37412025-02-28T11:18:44.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37422025-02-28T11:18:44.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37432025-02-28T11:18:44.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
37442025-02-28T11:18:44.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.508621ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
37452025-02-28T11:18:45.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5cc22bee-7672-47cf-b914-92a3be431b0e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37462025-02-28T11:18:45.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5cc22bee-7672-47cf-b914-92a3be431b0e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37472025-02-28T11:18:45.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1629 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5cc22bee-7672-47cf-b914-92a3be431b0e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37482025-02-28T11:18:46.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 03899db7-0dfc-48b0-a966-faad56234863 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37492025-02-28T11:18:46.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 03899db7-0dfc-48b0-a966-faad56234863 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37502025-02-28T11:18:46.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2438 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 03899db7-0dfc-48b0-a966-faad56234863 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37512025-02-28T11:18:47.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 605 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 461caa20-1651-4e02-bc2e-c8c36de4cc48 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
37522025-02-28T11:18:47.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8a0bad99-896c-4d58-8e23-2c4337365af0 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37532025-02-28T11:18:47.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8a0bad99-896c-4d58-8e23-2c4337365af0 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37542025-02-28T11:18:47.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8a0bad99-896c-4d58-8e23-2c4337365af0 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37552025-02-28T11:18:48.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fa8ae8e0-3e39-47eb-9fdd-d99172970229 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37562025-02-28T11:18:48.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fa8ae8e0-3e39-47eb-9fdd-d99172970229 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37572025-02-28T11:18:48.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fa8ae8e0-3e39-47eb-9fdd-d99172970229 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37582025-02-28T11:18:49.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9ee3b034-4638-40f4-bce0-c6536b3d5510 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37592025-02-28T11:18:49.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9ee3b034-4638-40f4-bce0-c6536b3d5510 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37602025-02-28T11:18:49.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9ee3b034-4638-40f4-bce0-c6536b3d5510 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37612025-02-28T11:18:50.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3c80dc51-cebb-4226-afff-d4a0be2b7947 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37622025-02-28T11:18:50.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3c80dc51-cebb-4226-afff-d4a0be2b7947 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37632025-02-28T11:18:50.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3c80dc51-cebb-4226-afff-d4a0be2b7947 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37642025-02-28T11:18:51.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 27a62c54-71b4-4e46-a346-d8bae35d5abf roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37652025-02-28T11:18:51.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 27a62c54-71b4-4e46-a346-d8bae35d5abf resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37662025-02-28T11:18:51.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2055 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 27a62c54-71b4-4e46-a346-d8bae35d5abf response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37672025-02-28T11:18:52.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 25522507-05a0-436b-b8ef-0b1afd80e971 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37682025-02-28T11:18:52.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 25522507-05a0-436b-b8ef-0b1afd80e971 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37692025-02-28T11:18:52.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 25522507-05a0-436b-b8ef-0b1afd80e971 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37702025-02-28T11:18:53.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 94c29843-c793-471d-93f6-fc3b31453786 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37712025-02-28T11:18:53.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 94c29843-c793-471d-93f6-fc3b31453786 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37722025-02-28T11:18:53.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1852 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 94c29843-c793-471d-93f6-fc3b31453786 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37732025-02-28T11:18:54.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
37742025-02-28T11:18:54.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37752025-02-28T11:18:54.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37762025-02-28T11:18:54.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
37772025-02-28T11:18:54.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37782025-02-28T11:18:54.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37792025-02-28T11:18:54.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37802025-02-28T11:18:54.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37812025-02-28T11:18:54.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37822025-02-28T11:18:54.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37832025-02-28T11:18:54.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37842025-02-28T11:18:54.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.322703ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37852025-02-28T11:18:54.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37862025-02-28T11:18:54.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37872025-02-28T11:18:54.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37882025-02-28T11:18:54.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37892025-02-28T11:18:54.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
37902025-02-28T11:18:54.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37912025-02-28T11:18:54.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37922025-02-28T11:18:54.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
37932025-02-28T11:18:54.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.191542ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
37942025-02-28T11:18:54.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bece8bf7-ba8a-4470-ade8-9841c175f1d8 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37952025-02-28T11:18:54.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bece8bf7-ba8a-4470-ade8-9841c175f1d8 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37962025-02-28T11:18:54.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1679 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bece8bf7-ba8a-4470-ade8-9841c175f1d8 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37972025-02-28T11:18:55.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 25b362a2-ef31-456c-b889-10b1d0b76906 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37982025-02-28T11:18:55.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 25b362a2-ef31-456c-b889-10b1d0b76906 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
37992025-02-28T11:18:55.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 25b362a2-ef31-456c-b889-10b1d0b76906 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38002025-02-28T11:18:56.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b4060af2-82d4-4f67-a220-cf13c55763e6 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38012025-02-28T11:18:56.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b4060af2-82d4-4f67-a220-cf13c55763e6 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38022025-02-28T11:18:56.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b4060af2-82d4-4f67-a220-cf13c55763e6 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38032025-02-28T11:18:57.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 787 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = cbf92944-a2d5-4dd3-9e04-326a72d508df response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
38042025-02-28T11:18:57.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cd45faa4-b99b-40e3-8428-5ff20ba51e65 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38052025-02-28T11:18:57.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cd45faa4-b99b-40e3-8428-5ff20ba51e65 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38062025-02-28T11:18:57.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cd45faa4-b99b-40e3-8428-5ff20ba51e65 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38072025-02-28T11:18:58.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c4ae3a7b-b626-4aed-a4b0-f3cc8dffe20e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38082025-02-28T11:18:58.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c4ae3a7b-b626-4aed-a4b0-f3cc8dffe20e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38092025-02-28T11:18:58.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2070 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c4ae3a7b-b626-4aed-a4b0-f3cc8dffe20e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38102025-02-28T11:18:59.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5753b918-1cd3-415f-b826-0f9e661f69b3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38112025-02-28T11:18:59.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5753b918-1cd3-415f-b826-0f9e661f69b3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38122025-02-28T11:18:59.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1745 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5753b918-1cd3-415f-b826-0f9e661f69b3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38132025-02-28T11:19:00.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cbb04eb6-9b3e-44db-8ac1-97757614187f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38142025-02-28T11:19:00.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cbb04eb6-9b3e-44db-8ac1-97757614187f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38152025-02-28T11:19:00.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cbb04eb6-9b3e-44db-8ac1-97757614187f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38162025-02-28T11:19:01.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = caa2eca2-9d8b-4392-ac50-f3b209f26384 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38172025-02-28T11:19:01.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = caa2eca2-9d8b-4392-ac50-f3b209f26384 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38182025-02-28T11:19:01.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1961 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = caa2eca2-9d8b-4392-ac50-f3b209f26384 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38192025-02-28T11:19:02.069ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:62240
38202025-02-28T11:19:02.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 0a9f339e-0900-48ac-95bb-3d198e077b80 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
38212025-02-28T11:19:02.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 0a9f339e-0900-48ac-95bb-3d198e077b80 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
38222025-02-28T11:19:02.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 0a9f339e-0900-48ac-95bb-3d198e077b80 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
38232025-02-28T11:19:02.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 3701d46f-dca7-46ea-9077-aaa257f5d07f roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
38242025-02-28T11:19:02.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 3701d46f-dca7-46ea-9077-aaa257f5d07f resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
38252025-02-28T11:19:02.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1747 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 3701d46f-dca7-46ea-9077-aaa257f5d07f response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
38262025-02-28T11:19:02.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 71fd12ad-3f67-4d73-8eb4-dcae57d5ed47 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38272025-02-28T11:19:02.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 71fd12ad-3f67-4d73-8eb4-dcae57d5ed47 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38282025-02-28T11:19:02.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1891 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 71fd12ad-3f67-4d73-8eb4-dcae57d5ed47 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38292025-02-28T11:19:03.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = df68ba2d-a75b-4374-bfd5-63ef221e3c69 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38302025-02-28T11:19:03.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = df68ba2d-a75b-4374-bfd5-63ef221e3c69 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38312025-02-28T11:19:03.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = df68ba2d-a75b-4374-bfd5-63ef221e3c69 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
38322025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
38332025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38342025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
38352025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
38362025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
38372025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
38382025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
38392025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38402025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38412025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
38422025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38432025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
38442025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38452025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
38462025-02-28T11:19:04.595ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-28 11:09:04.595364954 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38472025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38482025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38492025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
38502025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38512025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38522025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38532025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38542025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38552025-02-28T11:19:04.595ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c58b6d59-7cb2-478f-9d27-4e70c13f0853.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("daf1508c-21c6-4c2b-91a0-3e717092a118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 145951470 } })
38562025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38572025-02-28T11:19:04.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38582025-02-28T11:19:04.595ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cd949b0-a160-497e-a9d3-708f380c3425.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 146051692 } })
38592025-02-28T11:19:04.596ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
38602025-02-28T11:19:04.596ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
38612025-02-28T11:19:04.596ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
38622025-02-28T11:19:04.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.089684ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
38632025-02-28T11:19:04.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.139385ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
38642025-02-28T11:19:04.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38652025-02-28T11:19:04.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38662025-02-28T11:19:04.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 147575535 } })
38672025-02-28T11:19:04.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
38682025-02-28T11:19:04.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38692025-02-28T11:19:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38702025-02-28T11:19:04.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38712025-02-28T11:19:04.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
38722025-02-28T11:19:04.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38732025-02-28T11:19:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38742025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
38752025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38762025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
38772025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
38782025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
38792025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
38802025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38812025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
38822025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38832025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38842025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
38852025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38862025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
38872025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
38882025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38892025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38902025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
38912025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
38922025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
38932025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38942025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
38952025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38962025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
38972025-02-28T11:19:04.600ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38982025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38992025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
39002025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39012025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
39022025-02-28T11:19:04.600ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
39032025-02-28T11:19:04.600ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
39042025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
39052025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39062025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39072025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
39082025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39092025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
39102025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
39112025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
39122025-02-28T11:19:04.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 150674001 } })
39132025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
39142025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
39152025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39162025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
39172025-02-28T11:19:04.600ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 7549b177-a582-4102-91fb-b7e6324fd615
39182025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.03\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"7549b177-a582-4102-91fb-b7e6324fd615"}
39192025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
39202025-02-28T11:19:04.600ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39212025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39222025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
39232025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39242025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
39252025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39262025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39272025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
39282025-02-28T11:19:04.600ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
39292025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
39302025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39312025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39322025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39332025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
39342025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39352025-02-28T11:19:04.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
39362025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
39372025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39382025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39392025-02-28T11:19:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39402025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39412025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39422025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39432025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39442025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39452025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39462025-02-28T11:19:04.601ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
39472025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39482025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39492025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
39502025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39512025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39522025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39532025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
39542025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39552025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39562025-02-28T11:19:04.601ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-28 11:09:04.595364954 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39572025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.979038ms iteration = 11 status = {"expiration":"2025-02-28T11:09:04.595364954Z","pruned":[]}
39582025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39592025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39602025-02-28T11:19:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39612025-02-28T11:19:04.603ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.795365ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39622025-02-28T11:19:04.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39632025-02-28T11:19:04.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39642025-02-28T11:19:04.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39652025-02-28T11:19:04.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.556537ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
39662025-02-28T11:19:04.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39672025-02-28T11:19:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39682025-02-28T11:19:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39692025-02-28T11:19:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39702025-02-28T11:19:04.607ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39712025-02-28T11:19:04.607ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
39722025-02-28T11:19:04.607ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
39732025-02-28T11:19:04.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39742025-02-28T11:19:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39752025-02-28T11:19:04.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39762025-02-28T11:19:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39772025-02-28T11:19:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39782025-02-28T11:19:04.608ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39792025-02-28T11:19:04.608ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
39802025-02-28T11:19:04.608ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
39812025-02-28T11:19:04.608ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
39822025-02-28T11:19:04.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39832025-02-28T11:19:04.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39842025-02-28T11:19:04.609ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39852025-02-28T11:19:04.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862025-02-28T11:19:04.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39872025-02-28T11:19:04.610ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
39882025-02-28T11:19:04.610ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
39892025-02-28T11:19:04.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
39902025-02-28T11:19:04.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39912025-02-28T11:19:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
39922025-02-28T11:19:04.612ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39932025-02-28T11:19:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39942025-02-28T11:19:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
39952025-02-28T11:19:04.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
39962025-02-28T11:19:04.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39972025-02-28T11:19:04.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39982025-02-28T11:19:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39992025-02-28T11:19:04.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40002025-02-28T11:19:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
40012025-02-28T11:19:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40022025-02-28T11:19:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40032025-02-28T11:19:04.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40042025-02-28T11:19:04.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40052025-02-28T11:19:04.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40062025-02-28T11:19:04.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40072025-02-28T11:19:04.617ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40082025-02-28T11:19:04.617ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40092025-02-28T11:19:04.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40102025-02-28T11:19:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40112025-02-28T11:19:04.618ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40122025-02-28T11:19:04.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40132025-02-28T11:19:04.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40142025-02-28T11:19:04.619ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40152025-02-28T11:19:04.619ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.196612ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
40162025-02-28T11:19:04.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.59983ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
40172025-02-28T11:19:04.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
40182025-02-28T11:19:04.620ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
40192025-02-28T11:19:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
40202025-02-28T11:19:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40212025-02-28T11:19:04.624ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40222025-02-28T11:19:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40232025-02-28T11:19:04.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40242025-02-28T11:19:04.626ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40252025-02-28T11:19:04.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40262025-02-28T11:19:04.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40272025-02-28T11:19:04.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40282025-02-28T11:19:04.628ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40292025-02-28T11:19:04.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40302025-02-28T11:19:04.628ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40312025-02-28T11:19:04.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40322025-02-28T11:19:04.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40332025-02-28T11:19:04.629ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 29.154084ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40342025-02-28T11:19:04.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40352025-02-28T11:19:04.630ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
40362025-02-28T11:19:04.630ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
40372025-02-28T11:19:04.630ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 29.42886ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
40382025-02-28T11:19:04.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40392025-02-28T11:19:04.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40402025-02-28T11:19:04.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40412025-02-28T11:19:04.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40422025-02-28T11:19:04.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40432025-02-28T11:19:04.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
40442025-02-28T11:19:04.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
40452025-02-28T11:19:04.632ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40462025-02-28T11:19:04.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40472025-02-28T11:19:04.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40482025-02-28T11:19:04.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40492025-02-28T11:19:04.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40502025-02-28T11:19:04.634ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(ef80468f-f9c3-455a-bdd8-5d238905f749, 0), (3d1922db-2703-4ee9-89e1-24b9cf9f2058, 0), (4d2c9e92-f173-466f-a7c2-0da17e491a1c, 0)]
40512025-02-28T11:19:04.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40522025-02-28T11:19:04.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40532025-02-28T11:19:04.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40542025-02-28T11:19:04.634ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 184739851 } })
40552025-02-28T11:19:04.635ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40562025-02-28T11:19:04.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40572025-02-28T11:19:04.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40582025-02-28T11:19:04.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40592025-02-28T11:19:04.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40602025-02-28T11:19:04.637ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40612025-02-28T11:19:04.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40622025-02-28T11:19:04.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40632025-02-28T11:19:04.638ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40642025-02-28T11:19:04.640ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
40652025-02-28T11:19:04.640ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
40662025-02-28T11:19:04.640ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40672025-02-28T11:19:04.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
40682025-02-28T11:19:04.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40692025-02-28T11:19:04.641ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 191506756 } })
40702025-02-28T11:19:04.641ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
40712025-02-28T11:19:04.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40722025-02-28T11:19:04.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40732025-02-28T11:19:04.644ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40742025-02-28T11:19:04.645ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40752025-02-28T11:19:04.645ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40762025-02-28T11:19:04.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40772025-02-28T11:19:04.645ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40782025-02-28T11:19:04.645ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 0 version = 2
40792025-02-28T11:19:04.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40802025-02-28T11:19:04.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40812025-02-28T11:19:04.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40822025-02-28T11:19:04.645ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40832025-02-28T11:19:04.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40842025-02-28T11:19:04.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40852025-02-28T11:19:04.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
40862025-02-28T11:19:04.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40872025-02-28T11:19:04.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40882025-02-28T11:19:04.646ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40892025-02-28T11:19:04.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40902025-02-28T11:19:04.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40912025-02-28T11:19:04.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40922025-02-28T11:19:04.650ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40932025-02-28T11:19:04.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40942025-02-28T11:19:04.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40952025-02-28T11:19:04.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40962025-02-28T11:19:04.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40972025-02-28T11:19:04.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40982025-02-28T11:19:04.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40992025-02-28T11:19:04.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41002025-02-28T11:19:04.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41012025-02-28T11:19:04.658ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41022025-02-28T11:19:04.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41032025-02-28T11:19:04.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41042025-02-28T11:19:04.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41052025-02-28T11:19:04.664ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 64.192884ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
41062025-02-28T11:19:04.672ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41072025-02-28T11:19:04.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41082025-02-28T11:19:04.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
41092025-02-28T11:19:04.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
41102025-02-28T11:19:04.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.025368ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41112025-02-28T11:19:04.678ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41122025-02-28T11:19:04.678ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41132025-02-28T11:19:04.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41142025-02-28T11:19:04.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41152025-02-28T11:19:04.685ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41162025-02-28T11:19:04.685ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41172025-02-28T11:19:04.685ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.99518ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41182025-02-28T11:19:04.688ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41192025-02-28T11:19:04.688ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.879372ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41202025-02-28T11:19:04.690ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41212025-02-28T11:19:04.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41222025-02-28T11:19:04.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41232025-02-28T11:19:04.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41242025-02-28T11:19:04.760ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
41252025-02-28T11:19:04.760ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41262025-02-28T11:19:04.760ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5bb9c89-dd29-486f-9fd4-5ac160a32e52", "content-length": "26", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
41272025-02-28T11:19:04.760ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41282025-02-28T11:19:04.762ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41292025-02-28T11:19:04.762ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
41302025-02-28T11:19:04.762ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 162.079602ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
41312025-02-28T11:19:04.791ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41322025-02-28T11:19:04.820ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
41332025-02-28T11:19:04.820ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41342025-02-28T11:19:04.820ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "baeda41f-7e57-4816-8e30-f8924cdb5e5f", "content-length": "26", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
41352025-02-28T11:19:04.820ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41362025-02-28T11:19:04.822ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41372025-02-28T11:19:04.871ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41382025-02-28T11:19:04.920ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41392025-02-28T11:19:04.920ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41402025-02-28T11:19:04.920ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fcff74e-3d08-4195-b6a9-2e623a60d18f", "content-length": "372", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
41412025-02-28T11:19:04.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41422025-02-28T11:19:04.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41432025-02-28T11:19:04.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41442025-02-28T11:19:04.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41452025-02-28T11:19:04.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41462025-02-28T11:19:04.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41472025-02-28T11:19:04.927ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
41482025-02-28T11:19:04.927ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41492025-02-28T11:19:04.927ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "058f07f6-2468-439f-aa03-af20a1468648", "content-length": "26", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
41502025-02-28T11:19:04.927ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41512025-02-28T11:19:04.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41522025-02-28T11:19:04.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41532025-02-28T11:19:04.929ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
41542025-02-28T11:19:04.929ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41552025-02-28T11:19:04.929ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-28 11:09:18.396893 UTC dns_group = internal generation = 1
41562025-02-28T11:19:04.929ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 334.581315ms iteration = 11 status = {"generation":1}
41572025-02-28T11:19:04.930ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
41582025-02-28T11:19:04.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41592025-02-28T11:19:04.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41602025-02-28T11:19:04.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41612025-02-28T11:19:04.932ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
41622025-02-28T11:19:04.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
41632025-02-28T11:19:04.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
41642025-02-28T11:19:04.934ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
41652025-02-28T11:19:04.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
41662025-02-28T11:19:04.937ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 1 version = 2
41672025-02-28T11:19:04.937ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41682025-02-28T11:19:04.937ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-28 11:09:19.025515 UTC dns_group = external generation = 2
41692025-02-28T11:19:04.937ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 342.073766ms iteration = 11 status = {"generation":2}
41702025-02-28T11:19:04.938ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41712025-02-28T11:19:04.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2ad774d4-72c2-4201-bd74-8d6718c13db6 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
41722025-02-28T11:19:04.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2ad774d4-72c2-4201-bd74-8d6718c13db6 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
41732025-02-28T11:19:04.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
41742025-02-28T11:19:04.940ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
41752025-02-28T11:19:04.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
41762025-02-28T11:19:04.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2993 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2ad774d4-72c2-4201-bd74-8d6718c13db6 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
41772025-02-28T11:19:04.946ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
41782025-02-28T11:19:04.949ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
41792025-02-28T11:19:04.949ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 350.018217ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
41802025-02-28T11:19:04.951ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "d972e32e-d9f6-4eb0-bd91-28edb1a12af0", "content-length": "2", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
41812025-02-28T11:19:04.951ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:619 sled = http://[fd00:1122:3344:101::1]:12345
41822025-02-28T11:19:04.953ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 353.111773ms iteration = 3 status = {"last_run_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"operation":"list","target_sled":"586e5b1c-fe84-4966-a99c-108aa56b2c5f","time":"2025-02-28T11:14:05.030017261Z"},{"operation":"list","target_sled":"586e5b1c-fe84-4966-a99c-108aa56b2c5f","time":"2025-02-28T11:19:04.951797318Z"}]}
41832025-02-28T11:19:04.965ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41842025-02-28T11:19:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41852025-02-28T11:19:04.967ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 367.242175ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
41862025-02-28T11:19:04.968ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41872025-02-28T11:19:04.968ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41882025-02-28T11:19:04.968ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 368.354709ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41892025-02-28T11:19:04.969ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
41902025-02-28T11:19:04.969ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 368.732808ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
41912025-02-28T11:19:04.969ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41922025-02-28T11:19:04.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41932025-02-28T11:19:04.971ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41942025-02-28T11:19:04.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41952025-02-28T11:19:04.973ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41962025-02-28T11:19:04.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 373.606481ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41972025-02-28T11:19:04.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41982025-02-28T11:19:04.983ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41992025-02-28T11:19:04.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42002025-02-28T11:19:04.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42012025-02-28T11:19:04.987ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42022025-02-28T11:19:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
42032025-02-28T11:19:04.987ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42042025-02-28T11:19:04.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42052025-02-28T11:19:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42062025-02-28T11:19:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
42072025-02-28T11:19:04.992ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42082025-02-28T11:19:04.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42092025-02-28T11:19:04.993ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 392.883295ms iteration = 21 status = 0
42102025-02-28T11:19:04.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
42112025-02-28T11:19:04.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
42122025-02-28T11:19:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
42132025-02-28T11:19:04.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42142025-02-28T11:19:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42152025-02-28T11:19:04.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
42162025-02-28T11:19:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
42172025-02-28T11:19:04.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42182025-02-28T11:19:04.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42192025-02-28T11:19:04.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42202025-02-28T11:19:04.999ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
42212025-02-28T11:19:04.999ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42222025-02-28T11:19:05.000ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6da70a5a-4afe-450b-b6b3-b67d8cb0600d", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
42232025-02-28T11:19:05.000ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42242025-02-28T11:19:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42252025-02-28T11:19:05.000ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42262025-02-28T11:19:05.002ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
42272025-02-28T11:19:05.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
42282025-02-28T11:19:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
42292025-02-28T11:19:05.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42302025-02-28T11:19:05.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42312025-02-28T11:19:05.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42322025-02-28T11:19:05.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
42332025-02-28T11:19:05.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42342025-02-28T11:19:05.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42352025-02-28T11:19:05.006ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
42362025-02-28T11:19:05.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
42372025-02-28T11:19:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
42382025-02-28T11:19:05.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42392025-02-28T11:19:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42402025-02-28T11:19:05.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42412025-02-28T11:19:05.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42422025-02-28T11:19:05.011ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
42432025-02-28T11:19:05.011ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
42442025-02-28T11:19:05.011ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 411.521553ms iteration = 5 status = {"blueprint_id":"7549b177-a582-4102-91fb-b7e6324fd615","inventory_collection_id":"4d2c9e92-f173-466f-a7c2-0da17e491a1c","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
42452025-02-28T11:19:05.012ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbf1ad1c-2369-4b77-98c2-e756eda2ea46", "content-length": "1", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
42462025-02-28T11:19:05.012ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42472025-02-28T11:19:05.012ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42482025-02-28T11:19:05.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1c4090f8-23f5-4945-a207-f61514f26470", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
42492025-02-28T11:19:05.014ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42502025-02-28T11:19:05.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42512025-02-28T11:19:05.015ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42522025-02-28T11:19:05.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42532025-02-28T11:19:05.016ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 415.895517ms iteration = 21 status = {}
42542025-02-28T11:19:05.017ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42552025-02-28T11:19:05.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42562025-02-28T11:19:05.020ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 425.347419ms iteration = 21 status = null
42572025-02-28T11:19:05.023ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42582025-02-28T11:19:05.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42592025-02-28T11:19:05.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42602025-02-28T11:19:05.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42612025-02-28T11:19:05.026ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42622025-02-28T11:19:05.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42632025-02-28T11:19:05.028ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42642025-02-28T11:19:05.029ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-28T11:09:02.015184Z, time_modified: 2025-02-28T11:09:02.015184Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }) }
42652025-02-28T11:19:05.029ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 434.283941ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]}},"default_endpoint":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
42662025-02-28T11:19:05.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
42672025-02-28T11:19:05.032ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42682025-02-28T11:19:05.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42692025-02-28T11:19:05.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42702025-02-28T11:19:05.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42712025-02-28T11:19:05.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42722025-02-28T11:19:05.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42732025-02-28T11:19:05.038ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42742025-02-28T11:19:05.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42752025-02-28T11:19:05.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42762025-02-28T11:19:05.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42772025-02-28T11:19:05.041ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42782025-02-28T11:19:05.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42792025-02-28T11:19:05.043ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42802025-02-28T11:19:05.043ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
42812025-02-28T11:19:05.043ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
42822025-02-28T11:19:05.043ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
42832025-02-28T11:19:05.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42842025-02-28T11:19:05.043ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "e20c7f83-534e-47e7-b603-41522dfba8e2", "content-length": "476", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
42852025-02-28T11:19:05.043ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
42862025-02-28T11:19:05.044ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e191e2ce-f0b7-4d21-9db5-06844e1327c4", "content-length": "734", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
42872025-02-28T11:19:05.044ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
42882025-02-28T11:19:05.044ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "87350102-4e36-48a8-84a9-056ae5e1f4be", "content-length": "111", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
42892025-02-28T11:19:05.044ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
42902025-02-28T11:19:05.044ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42912025-02-28T11:19:05.044ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b921166e-0f69-4d99-8b91-1664f6713117", "content-length": "111", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
42922025-02-28T11:19:05.044ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
42932025-02-28T11:19:05.045ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b317376-7841-4087-9580-58851d4dc8c0", "content-length": "167", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
42942025-02-28T11:19:05.045ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
42952025-02-28T11:19:05.045ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcbc2b8a-2d07-46cb-8ad0-176027e0fc1d", "content-length": "167", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
42962025-02-28T11:19:05.045ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
42972025-02-28T11:19:05.045ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e838a0b-7f59-4d11-9c7d-23773a68b954", "content-length": "175", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
42982025-02-28T11:19:05.045ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
42992025-02-28T11:19:05.045ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1843baa0-a2e6-4889-9d75-8fb24f548a76", "content-length": "175", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43002025-02-28T11:19:05.045ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
43012025-02-28T11:19:05.046ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b39b178-4efe-4167-81ea-61719a813f96", "content-length": "702", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43022025-02-28T11:19:05.046ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
43032025-02-28T11:19:05.046ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5481bbec-29d4-4d4f-b49b-f1ab6b7715d0", "content-length": "727", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43042025-02-28T11:19:05.046ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
43052025-02-28T11:19:05.046ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6d701e1-c981-4330-aa30-2e6496516ee3", "content-length": "729", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43062025-02-28T11:19:05.046ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
43072025-02-28T11:19:05.046ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c70028f6-81b0-464d-ae18-80cf2250861f", "content-length": "728", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43082025-02-28T11:19:05.046ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
43092025-02-28T11:19:05.046ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c49222ea-f941-47e3-b73a-370d85e3dc00", "content-length": "722", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43102025-02-28T11:19:05.046ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
43112025-02-28T11:19:05.047ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfd271a8-9767-456b-b6ad-016dfe0d56e7", "content-length": "109", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43122025-02-28T11:19:05.047ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
43132025-02-28T11:19:05.047ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f15dde0d-9a0c-4b92-bfce-5068b43bcf57", "content-length": "109", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43142025-02-28T11:19:05.047ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
43152025-02-28T11:19:05.047ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "52f80a50-cfa4-467c-8374-37267383a2ac", "content-length": "169", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43162025-02-28T11:19:05.047ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
43172025-02-28T11:19:05.047ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "04024730-30ff-479b-ba74-638b96726108", "content-length": "169", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43182025-02-28T11:19:05.047ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
43192025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a16c6b95-0800-4d5e-abd4-9c1de16d9dcc", "content-length": "178", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43202025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
43212025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d700a91-6197-40b7-a523-cc824e9953d4", "content-length": "178", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43222025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
43232025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
43242025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "03b8c42b-d5f6-4f6b-88e2-83de39b129d1", "content-length": "702", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43252025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43262025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
43272025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab3d42cc-9adf-4886-9b47-04dca1899b9d", "content-length": "727", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43282025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
43292025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43302025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0609621-63bf-4b3d-8a1e-0fcd4491dc85", "content-length": "729", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43312025-02-28T11:19:05.048ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
43322025-02-28T11:19:05.049ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7aeba082-eacf-4c1d-adc5-5eed103f7593", "content-length": "728", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
43332025-02-28T11:19:05.049ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43342025-02-28T11:19:05.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43352025-02-28T11:19:05.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43362025-02-28T11:19:05.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43372025-02-28T11:19:05.050ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43382025-02-28T11:19:05.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43392025-02-28T11:19:05.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43402025-02-28T11:19:05.052ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 456.686511ms iteration = 21 status = {}
43412025-02-28T11:19:05.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
43422025-02-28T11:19:05.052ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43432025-02-28T11:19:05.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43442025-02-28T11:19:05.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43452025-02-28T11:19:05.053ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43462025-02-28T11:19:05.053ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43472025-02-28T11:19:05.055ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
43482025-02-28T11:19:05.055ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43492025-02-28T11:19:05.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43502025-02-28T11:19:05.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
43512025-02-28T11:19:05.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43522025-02-28T11:19:05.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43532025-02-28T11:19:05.058ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 457.827345ms iteration = 23 status = {"physical_disks_added":0}
43542025-02-28T11:19:05.059ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
43552025-02-28T11:19:05.059ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 458.641633ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
43562025-02-28T11:19:05.061ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43572025-02-28T11:19:05.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43582025-02-28T11:19:05.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43592025-02-28T11:19:05.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43602025-02-28T11:19:05.065ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43612025-02-28T11:19:05.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43622025-02-28T11:19:05.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43632025-02-28T11:19:05.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43642025-02-28T11:19:05.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43652025-02-28T11:19:05.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43662025-02-28T11:19:05.105ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
43672025-02-28T11:19:05.105ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c63a708f-29bd-42f5-95cd-8ef09771a619", "date": "Fri, 28 Feb 2025 11:19:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43682025-02-28T11:19:05.105ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43692025-02-28T11:19:05.106ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b8e6f501-d563-4e0b-a32d-51f8305217af", "date": "Fri, 28 Feb 2025 11:19:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43702025-02-28T11:19:05.106ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43712025-02-28T11:19:05.108ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43722025-02-28T11:19:05.108ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 512.773142ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43732025-02-28T11:19:05.166ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
43742025-02-28T11:19:05.166ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
43752025-02-28T11:19:05.167ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43762025-02-28T11:19:05.168ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43772025-02-28T11:19:05.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43782025-02-28T11:19:05.168ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43792025-02-28T11:19:05.168ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43802025-02-28T11:19:05.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43812025-02-28T11:19:05.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43822025-02-28T11:19:05.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43832025-02-28T11:19:05.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43842025-02-28T11:19:05.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43852025-02-28T11:19:05.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43862025-02-28T11:19:05.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43872025-02-28T11:19:05.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43882025-02-28T11:19:05.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43892025-02-28T11:19:05.172ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43902025-02-28T11:19:05.176ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
43912025-02-28T11:19:05.176ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43922025-02-28T11:19:05.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43932025-02-28T11:19:05.178ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43942025-02-28T11:19:05.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43952025-02-28T11:19:05.179ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43962025-02-28T11:19:05.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43972025-02-28T11:19:05.180ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43982025-02-28T11:19:05.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
43992025-02-28T11:19:05.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44002025-02-28T11:19:05.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44012025-02-28T11:19:05.189ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
44022025-02-28T11:19:05.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44032025-02-28T11:19:05.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44042025-02-28T11:19:05.191ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44052025-02-28T11:19:05.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
44062025-02-28T11:19:05.193ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44072025-02-28T11:19:05.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44082025-02-28T11:19:05.194ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
44092025-02-28T11:19:05.194ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: c03a2a63-3c7c-4169-b89d-5b0f43ec82fc, kind: Service { id: 441521c3-bf8d-4bb0-a351-260cd1158738 }, name: Name("external-dns-441521c3-bf8d-4bb0-a351-260cd1158738"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d424af3b-8a17-4820-bf24-c1f0418e7118, kind: Service { id: 2cd949b0-a160-497e-a9d3-708f380c3425 }, name: Name("external-dns-2cd949b0-a160-497e-a9d3-708f380c3425"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 36])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6e074c23-ab78-4f46-9d2f-0717d63771d4, kind: Service { id: d9f8d88d-6bf3-4106-b343-223cfff34ebb }, name: Name("nexus-d9f8d88d-6bf3-4106-b343-223cfff34ebb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9d49004a-e4c7-4702-ba82-b1544850ef38, kind: Service { id: a49a6ffa-af87-4978-97cd-b29e51ec9497 }, name: Name("nexus-a49a6ffa-af87-4978-97cd-b29e51ec9497"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 54])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a269abb3-e61c-4678-9e46-a12f28b69319, kind: Service { id: 549db258-8cd5-4bc5-bd79-0f3216a4cc97 }, name: Name("nexus-549db258-8cd5-4bc5-bd79-0f3216a4cc97"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
44102025-02-28T11:19:05.194ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
44112025-02-28T11:19:05.230ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44122025-02-28T11:19:05.230ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1b68c0af-c14e-4d49-8dfd-e2b77786db36", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44132025-02-28T11:19:05.230ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44142025-02-28T11:19:05.232ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bf3c0fd2-4172-4d8e-bd35-27165552b624", "date": "Fri, 28 Feb 2025 11:19:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44152025-02-28T11:19:05.232ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44162025-02-28T11:19:05.233ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "49bd440f-d47b-498e-b491-ad153e89b707", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44172025-02-28T11:19:05.233ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44182025-02-28T11:19:05.235ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44192025-02-28T11:19:05.235ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 640.285433ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
44202025-02-28T11:19:05.250ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, time_created: 2025-02-28T11:09:14.860004Z, time_modified: 2025-02-28T11:09:14.860004Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
44212025-02-28T11:19:05.250ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
44222025-02-28T11:19:05.250ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44232025-02-28T11:19:05.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44242025-02-28T11:19:05.253ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44252025-02-28T11:19:05.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44262025-02-28T11:19:05.296ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44272025-02-28T11:19:05.296ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5da1643d-6e92-41d0-a0b7-6c8dbc8bf444", "content-length": "691", "date": "Fri, 28 Feb 2025 11:19:05 GMT"} })
44282025-02-28T11:19:05.296ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
44292025-02-28T11:19:05.296ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
44302025-02-28T11:19:05.296ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
44312025-02-28T11:19:05.297ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44322025-02-28T11:19:05.298ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 697.902626ms iteration = 21 status = {}
44332025-02-28T11:19:05.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
44342025-02-28T11:19:05.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44352025-02-28T11:19:05.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44362025-02-28T11:19:05.305ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
44372025-02-28T11:19:05.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44382025-02-28T11:19:05.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44392025-02-28T11:19:05.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44402025-02-28T11:19:05.317ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "531ae27a-64d6-480b-b1bb-a17e475241d3", "content-length": "134", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
44412025-02-28T11:19:05.317ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44422025-02-28T11:19:05.317ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
44432025-02-28T11:19:05.317ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44442025-02-28T11:19:05.317ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44452025-02-28T11:19:05.317ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44462025-02-28T11:19:05.317ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44472025-02-28T11:19:05.317ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44482025-02-28T11:19:05.317ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44492025-02-28T11:19:05.317ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44502025-02-28T11:19:05.317ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44512025-02-28T11:19:05.317ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
44522025-02-28T11:19:05.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44532025-02-28T11:19:05.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44542025-02-28T11:19:05.320ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44552025-02-28T11:19:05.320ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b69e5983-94e5-4122-b22d-d5f63311e862", "content-length": "2", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
44562025-02-28T11:19:05.320ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44572025-02-28T11:19:05.320ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cb66498-ac75-45e1-869b-f9bf289559fc", "content-length": "52", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
44582025-02-28T11:19:05.320ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
44592025-02-28T11:19:05.320ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44602025-02-28T11:19:05.336ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
44612025-02-28T11:19:05.390ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "dbefac4b-4e16-43f7-b256-3bb424c49c28", "date": "Fri, 28 Feb 2025 11:19:05 GMT"} })
44622025-02-28T11:19:05.391ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
44632025-02-28T11:19:05.391ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 791.109162ms
44642025-02-28T11:19:05.391ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 791.122193ms iteration = 3 status = {}
44652025-02-28T11:19:05.416ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8fa3367-ccdb-49e4-8d6d-294c761063bb", "content-length": "31976", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
44662025-02-28T11:19:05.419ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
44672025-02-28T11:19:05.419ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
44682025-02-28T11:19:05.419ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
44692025-02-28T11:19:05.420ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44702025-02-28T11:19:05.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44712025-02-28T11:19:05.422ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44722025-02-28T11:19:05.424ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
44732025-02-28T11:19:05.424ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
44742025-02-28T11:19:05.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
44752025-02-28T11:19:05.450ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "75f107f7-23cc-4df2-bf4c-7c04e4e5140a", "date": "Fri, 28 Feb 2025 11:19:05 GMT"} })
44762025-02-28T11:19:05.450ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
44772025-02-28T11:19:05.450ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44782025-02-28T11:19:05.450ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3b6156f-10d9-4b67-84c4-b687d4beca96", "content-length": "682", "date": "Fri, 28 Feb 2025 11:19:04 GMT"} })
44792025-02-28T11:19:05.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44802025-02-28T11:19:05.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44812025-02-28T11:19:05.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44822025-02-28T11:19:05.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44832025-02-28T11:19:05.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44842025-02-28T11:19:05.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44852025-02-28T11:19:05.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44862025-02-28T11:19:05.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44872025-02-28T11:19:05.469ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 868.900408ms iteration = 21 status = {}
44882025-02-28T11:19:05.613ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 24ea886d-57f8-4084-8f15-1a7e76482f1c file = nexus/db-queries/src/db/datastore/inventory.rs:1010
44892025-02-28T11:19:05.614ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 24ea886d-57f8-4084-8f15-1a7e76482f1c time_started = 2025-02-28 11:19:05.043360 UTC
44902025-02-28T11:19:05.614ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
44912025-02-28T11:19:05.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44922025-02-28T11:19:05.614ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.013773421s iteration = 3 status = {"collection_id":"24ea886d-57f8-4084-8f15-1a7e76482f1c","time_done":"2025-02-28 11:19:05.419055 UTC","time_started":"2025-02-28 11:19:05.043360 UTC"}
44932025-02-28T11:19:05.614ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
44942025-02-28T11:19:05.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
44952025-02-28T11:19:05.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
44962025-02-28T11:19:05.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44972025-02-28T11:19:05.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44982025-02-28T11:19:05.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44992025-02-28T11:19:05.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45002025-02-28T11:19:05.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45012025-02-28T11:19:05.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
45022025-02-28T11:19:05.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
45032025-02-28T11:19:05.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
45042025-02-28T11:19:05.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45052025-02-28T11:19:05.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
45062025-02-28T11:19:05.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
45072025-02-28T11:19:05.621ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45082025-02-28T11:19:05.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45092025-02-28T11:19:05.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45102025-02-28T11:19:05.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45112025-02-28T11:19:05.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45122025-02-28T11:19:05.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45132025-02-28T11:19:05.634ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 20.334955ms iteration = 24 status = {"physical_disks_added":0}
45142025-02-28T11:19:05.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
45152025-02-28T11:19:05.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
45162025-02-28T11:19:05.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45172025-02-28T11:19:05.648ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
45182025-02-28T11:19:05.648ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
45192025-02-28T11:19:05.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
45202025-02-28T11:19:05.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45212025-02-28T11:19:05.651ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
45222025-02-28T11:19:05.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
45232025-02-28T11:19:05.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
45242025-02-28T11:19:05.654ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
45252025-02-28T11:19:05.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
45262025-02-28T11:19:05.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272025-02-28T11:19:05.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
45282025-02-28T11:19:05.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
45292025-02-28T11:19:05.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
45302025-02-28T11:19:05.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45312025-02-28T11:19:05.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
45322025-02-28T11:19:05.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
45332025-02-28T11:19:05.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
45342025-02-28T11:19:05.662ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
45352025-02-28T11:19:05.662ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 48.377866ms iteration = 6 status = {"blueprint_id":"7549b177-a582-4102-91fb-b7e6324fd615","inventory_collection_id":"24ea886d-57f8-4084-8f15-1a7e76482f1c","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
45362025-02-28T11:19:05.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f2c2f9d2-5995-4732-8aec-4d5c852e3d71 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45372025-02-28T11:19:05.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f2c2f9d2-5995-4732-8aec-4d5c852e3d71 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45382025-02-28T11:19:05.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4039 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f2c2f9d2-5995-4732-8aec-4d5c852e3d71 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45392025-02-28T11:19:06.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 32a2ec18-ad8e-44ec-a78d-029c2ce4a934 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45402025-02-28T11:19:06.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 32a2ec18-ad8e-44ec-a78d-029c2ce4a934 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45412025-02-28T11:19:06.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 32a2ec18-ad8e-44ec-a78d-029c2ce4a934 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45422025-02-28T11:19:07.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 605 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = b733d2ec-7099-46f4-a8af-11dbdc589482 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
45432025-02-28T11:19:08.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d03407c4-19f8-44b1-9d47-699af30c4b1e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45442025-02-28T11:19:08.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d03407c4-19f8-44b1-9d47-699af30c4b1e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45452025-02-28T11:19:08.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2908 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d03407c4-19f8-44b1-9d47-699af30c4b1e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45462025-02-28T11:19:09.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cd2aa2bf-8087-4a6f-b21e-2c9d2ea0e7f7 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45472025-02-28T11:19:09.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cd2aa2bf-8087-4a6f-b21e-2c9d2ea0e7f7 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45482025-02-28T11:19:09.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cd2aa2bf-8087-4a6f-b21e-2c9d2ea0e7f7 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45492025-02-28T11:19:10.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 50bf12fe-d72d-4f21-b83c-12ec11d05550 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45502025-02-28T11:19:10.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 50bf12fe-d72d-4f21-b83c-12ec11d05550 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45512025-02-28T11:19:10.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2069 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 50bf12fe-d72d-4f21-b83c-12ec11d05550 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45522025-02-28T11:19:11.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ff4c326c-0827-4ecc-b850-e7a9ad5a2cd9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45532025-02-28T11:19:11.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ff4c326c-0827-4ecc-b850-e7a9ad5a2cd9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45542025-02-28T11:19:11.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ff4c326c-0827-4ecc-b850-e7a9ad5a2cd9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45552025-02-28T11:19:12.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = af34dfb9-34c0-4ed1-8b01-f1fc5a6f170d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45562025-02-28T11:19:12.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = af34dfb9-34c0-4ed1-8b01-f1fc5a6f170d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45572025-02-28T11:19:12.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = af34dfb9-34c0-4ed1-8b01-f1fc5a6f170d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45582025-02-28T11:19:13.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5f30ccfb-eee8-49aa-ad5e-05ee0fd775cb roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45592025-02-28T11:19:13.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5f30ccfb-eee8-49aa-ad5e-05ee0fd775cb resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45602025-02-28T11:19:13.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5f30ccfb-eee8-49aa-ad5e-05ee0fd775cb response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45612025-02-28T11:19:14.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d317299d-a94f-4ea6-acb0-3278a729317f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45622025-02-28T11:19:14.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d317299d-a94f-4ea6-acb0-3278a729317f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45632025-02-28T11:19:14.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1726 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d317299d-a94f-4ea6-acb0-3278a729317f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45642025-02-28T11:19:14.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
45652025-02-28T11:19:14.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45662025-02-28T11:19:14.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45672025-02-28T11:19:14.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
45682025-02-28T11:19:14.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45692025-02-28T11:19:14.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45702025-02-28T11:19:14.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45712025-02-28T11:19:14.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45722025-02-28T11:19:14.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45732025-02-28T11:19:14.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45742025-02-28T11:19:14.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45752025-02-28T11:19:14.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45762025-02-28T11:19:14.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45772025-02-28T11:19:14.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45782025-02-28T11:19:14.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45792025-02-28T11:19:14.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
45802025-02-28T11:19:14.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45812025-02-28T11:19:14.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45822025-02-28T11:19:14.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
45832025-02-28T11:19:14.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.777525ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
45842025-02-28T11:19:14.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.663597ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45852025-02-28T11:19:15.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2492a63f-c5de-477b-83f9-ef38da06620c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45862025-02-28T11:19:15.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2492a63f-c5de-477b-83f9-ef38da06620c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45872025-02-28T11:19:15.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1853 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2492a63f-c5de-477b-83f9-ef38da06620c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45882025-02-28T11:19:16.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62dbb913-791d-4e36-a07b-7afeda4458d4 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45892025-02-28T11:19:16.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62dbb913-791d-4e36-a07b-7afeda4458d4 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45902025-02-28T11:19:16.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1933 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62dbb913-791d-4e36-a07b-7afeda4458d4 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45912025-02-28T11:19:17.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 577 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 173a32a8-a06f-47b5-8811-992f75fc8a4b response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
45922025-02-28T11:19:17.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 14af7361-59a7-4dc3-aec7-613457ea2c63 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45932025-02-28T11:19:17.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 14af7361-59a7-4dc3-aec7-613457ea2c63 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45942025-02-28T11:19:17.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2753 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 14af7361-59a7-4dc3-aec7-613457ea2c63 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45952025-02-28T11:19:18.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9bf49f6c-a77f-460c-8924-476d96745098 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45962025-02-28T11:19:18.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9bf49f6c-a77f-460c-8924-476d96745098 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45972025-02-28T11:19:18.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2084 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9bf49f6c-a77f-460c-8924-476d96745098 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45982025-02-28T11:19:19.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e3ceaf22-ce54-4fb9-829d-6d8c9fd7187f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
45992025-02-28T11:19:19.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e3ceaf22-ce54-4fb9-829d-6d8c9fd7187f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46002025-02-28T11:19:19.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2063 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e3ceaf22-ce54-4fb9-829d-6d8c9fd7187f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46012025-02-28T11:19:20.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ed38f99d-95e9-403b-95aa-47dc1b6bde4d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46022025-02-28T11:19:20.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ed38f99d-95e9-403b-95aa-47dc1b6bde4d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46032025-02-28T11:19:20.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ed38f99d-95e9-403b-95aa-47dc1b6bde4d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46042025-02-28T11:19:21.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 92794649-b7e3-4db4-8bab-52ac5ee3e81f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46052025-02-28T11:19:21.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 92794649-b7e3-4db4-8bab-52ac5ee3e81f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46062025-02-28T11:19:21.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 92794649-b7e3-4db4-8bab-52ac5ee3e81f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46072025-02-28T11:19:22.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 296fd43a-5e08-4859-9a70-ea3acdd22101 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46082025-02-28T11:19:22.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 296fd43a-5e08-4859-9a70-ea3acdd22101 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46092025-02-28T11:19:22.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 296fd43a-5e08-4859-9a70-ea3acdd22101 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46102025-02-28T11:19:23.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0aa7c67a-0259-4b75-b102-88b67f29660e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46112025-02-28T11:19:23.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0aa7c67a-0259-4b75-b102-88b67f29660e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46122025-02-28T11:19:23.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1723 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0aa7c67a-0259-4b75-b102-88b67f29660e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46132025-02-28T11:19:24.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e0258b98-2c7a-41a7-9399-cdd0571a02d9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46142025-02-28T11:19:24.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e0258b98-2c7a-41a7-9399-cdd0571a02d9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46152025-02-28T11:19:24.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e0258b98-2c7a-41a7-9399-cdd0571a02d9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46162025-02-28T11:19:24.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
46172025-02-28T11:19:24.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46182025-02-28T11:19:24.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46192025-02-28T11:19:24.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
46202025-02-28T11:19:24.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46212025-02-28T11:19:24.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46222025-02-28T11:19:24.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46232025-02-28T11:19:24.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46242025-02-28T11:19:24.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46252025-02-28T11:19:24.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46262025-02-28T11:19:24.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46272025-02-28T11:19:24.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46282025-02-28T11:19:24.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46292025-02-28T11:19:24.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46302025-02-28T11:19:24.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46312025-02-28T11:19:24.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
46322025-02-28T11:19:24.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46332025-02-28T11:19:24.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46342025-02-28T11:19:24.617ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
46352025-02-28T11:19:24.617ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.374653ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
46362025-02-28T11:19:24.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.299389ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46372025-02-28T11:19:25.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d6641992-5c14-4e5e-9a61-23624c6d9191 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46382025-02-28T11:19:25.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d6641992-5c14-4e5e-9a61-23624c6d9191 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46392025-02-28T11:19:25.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d6641992-5c14-4e5e-9a61-23624c6d9191 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46402025-02-28T11:19:26.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5f409b0d-533b-4e8e-9406-0ded0b21f363 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46412025-02-28T11:19:26.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5f409b0d-533b-4e8e-9406-0ded0b21f363 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46422025-02-28T11:19:26.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5f409b0d-533b-4e8e-9406-0ded0b21f363 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46432025-02-28T11:19:27.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 606 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 8108fba8-5ed1-4331-86d4-beca19a18b08 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
46442025-02-28T11:19:27.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4a22a298-f54b-40e0-80c7-ea8041b4cdd3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46452025-02-28T11:19:27.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4a22a298-f54b-40e0-80c7-ea8041b4cdd3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46462025-02-28T11:19:27.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1874 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4a22a298-f54b-40e0-80c7-ea8041b4cdd3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46472025-02-28T11:19:28.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7df7f30f-f562-4683-a4c2-60cdcf3352c1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46482025-02-28T11:19:28.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7df7f30f-f562-4683-a4c2-60cdcf3352c1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46492025-02-28T11:19:28.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7df7f30f-f562-4683-a4c2-60cdcf3352c1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46502025-02-28T11:19:29.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 44427844-f8ea-4273-9ba4-cde94ba15078 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46512025-02-28T11:19:29.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 44427844-f8ea-4273-9ba4-cde94ba15078 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46522025-02-28T11:19:29.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 44427844-f8ea-4273-9ba4-cde94ba15078 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46532025-02-28T11:19:30.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7f6defd8-5450-493a-bb70-4c92d6a0614e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46542025-02-28T11:19:30.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7f6defd8-5450-493a-bb70-4c92d6a0614e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46552025-02-28T11:19:30.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7f6defd8-5450-493a-bb70-4c92d6a0614e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46562025-02-28T11:19:31.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 08903a07-74a9-488f-a6ac-7bb7467e2cc6 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46572025-02-28T11:19:31.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 08903a07-74a9-488f-a6ac-7bb7467e2cc6 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46582025-02-28T11:19:31.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 08903a07-74a9-488f-a6ac-7bb7467e2cc6 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46592025-02-28T11:19:32.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 61cd58e9-044b-4093-96ab-9e86871b00e9 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
46602025-02-28T11:19:32.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 61cd58e9-044b-4093-96ab-9e86871b00e9 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
46612025-02-28T11:19:32.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3653 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 61cd58e9-044b-4093-96ab-9e86871b00e9 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
46622025-02-28T11:19:32.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = ff08aaef-4d6a-4219-9146-a37f67ffccda roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
46632025-02-28T11:19:32.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = ff08aaef-4d6a-4219-9146-a37f67ffccda resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
46642025-02-28T11:19:32.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2626 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = ff08aaef-4d6a-4219-9146-a37f67ffccda response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
46652025-02-28T11:19:32.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 18a2a0fa-19d7-4403-bfca-7d13deafa37b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46662025-02-28T11:19:32.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 18a2a0fa-19d7-4403-bfca-7d13deafa37b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46672025-02-28T11:19:32.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 18a2a0fa-19d7-4403-bfca-7d13deafa37b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46682025-02-28T11:19:33.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e46f4203-6040-4fe0-ba6c-558c9bf224f1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46692025-02-28T11:19:33.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e46f4203-6040-4fe0-ba6c-558c9bf224f1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46702025-02-28T11:19:33.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e46f4203-6040-4fe0-ba6c-558c9bf224f1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46712025-02-28T11:19:34.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 21dd3c25-ba3c-4d7b-a5ed-8ae98109d1e2 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46722025-02-28T11:19:34.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 21dd3c25-ba3c-4d7b-a5ed-8ae98109d1e2 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46732025-02-28T11:19:34.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2476 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 21dd3c25-ba3c-4d7b-a5ed-8ae98109d1e2 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
46742025-02-28T11:19:34.594ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
46752025-02-28T11:19:34.594ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
46762025-02-28T11:19:34.594ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46772025-02-28T11:19:34.594ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46782025-02-28T11:19:34.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46792025-02-28T11:19:34.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46802025-02-28T11:19:34.597ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
46812025-02-28T11:19:34.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 147597753 } })
46822025-02-28T11:19:34.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
46832025-02-28T11:19:34.598ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 148047813 } })
46842025-02-28T11:19:34.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
46852025-02-28T11:19:34.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
46862025-02-28T11:19:34.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46872025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46882025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
46892025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
46902025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46912025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
46922025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46932025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46942025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
46952025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46962025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46972025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
46982025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46992025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
47002025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
47012025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47022025-02-28T11:19:34.600ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
47032025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47042025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
47052025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47062025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
47072025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
47082025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47092025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47102025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
47112025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47122025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
47132025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
47142025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
47152025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
47162025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
47172025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47182025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
47192025-02-28T11:19:34.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47202025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47212025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47222025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47232025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47242025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47252025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47262025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47272025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47282025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47292025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47302025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47312025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
47322025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47332025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47342025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47352025-02-28T11:19:34.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47362025-02-28T11:19:34.602ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.1115ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47372025-02-28T11:19:34.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47382025-02-28T11:19:34.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47392025-02-28T11:19:34.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47402025-02-28T11:19:34.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47412025-02-28T11:19:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47422025-02-28T11:19:34.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47432025-02-28T11:19:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47442025-02-28T11:19:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47452025-02-28T11:19:34.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47462025-02-28T11:19:34.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47472025-02-28T11:19:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47482025-02-28T11:19:34.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47492025-02-28T11:19:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47502025-02-28T11:19:34.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47512025-02-28T11:19:34.608ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47522025-02-28T11:19:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47532025-02-28T11:19:34.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47542025-02-28T11:19:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47552025-02-28T11:19:34.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47562025-02-28T11:19:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47572025-02-28T11:19:34.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47582025-02-28T11:19:34.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47592025-02-28T11:19:34.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47602025-02-28T11:19:34.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.410098ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47612025-02-28T11:19:34.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47622025-02-28T11:19:34.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47632025-02-28T11:19:34.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47642025-02-28T11:19:34.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47652025-02-28T11:19:34.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47662025-02-28T11:19:34.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47672025-02-28T11:19:34.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47682025-02-28T11:19:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47692025-02-28T11:19:34.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47702025-02-28T11:19:34.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47712025-02-28T11:19:34.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47722025-02-28T11:19:34.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47732025-02-28T11:19:34.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47742025-02-28T11:19:34.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47752025-02-28T11:19:34.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47762025-02-28T11:19:34.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47772025-02-28T11:19:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47782025-02-28T11:19:34.623ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 173134630 } })
47792025-02-28T11:19:34.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
47802025-02-28T11:19:34.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47812025-02-28T11:19:34.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47822025-02-28T11:19:34.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47832025-02-28T11:19:34.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.245227ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
47842025-02-28T11:19:34.652ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47852025-02-28T11:19:34.652ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47862025-02-28T11:19:34.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47872025-02-28T11:19:34.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47882025-02-28T11:19:34.654ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
47892025-02-28T11:19:34.654ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47902025-02-28T11:19:34.655ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "34216481-3d1d-40d7-ab0a-61e047d31505", "content-length": "26", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
47912025-02-28T11:19:34.655ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47922025-02-28T11:19:34.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47932025-02-28T11:19:34.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47942025-02-28T11:19:34.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47952025-02-28T11:19:34.658ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47962025-02-28T11:19:34.658ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47972025-02-28T11:19:34.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47982025-02-28T11:19:34.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47992025-02-28T11:19:34.659ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 58.597115ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
48002025-02-28T11:19:34.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48012025-02-28T11:19:34.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48022025-02-28T11:19:34.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48032025-02-28T11:19:34.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48042025-02-28T11:19:34.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48052025-02-28T11:19:34.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48062025-02-28T11:19:34.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.753261ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
48072025-02-28T11:19:34.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48082025-02-28T11:19:34.663ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48092025-02-28T11:19:34.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48102025-02-28T11:19:34.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
48112025-02-28T11:19:34.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48122025-02-28T11:19:34.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48132025-02-28T11:19:34.665ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
48142025-02-28T11:19:34.665ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48152025-02-28T11:19:34.666ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6b2f381-e188-444d-86ac-12497a25ecc1", "content-length": "26", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
48162025-02-28T11:19:34.666ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48172025-02-28T11:19:34.667ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
48182025-02-28T11:19:34.667ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.475084ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
48192025-02-28T11:19:34.668ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48202025-02-28T11:19:34.668ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 67.25069ms iteration = 22 status = 0
48212025-02-28T11:19:34.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48222025-02-28T11:19:34.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48232025-02-28T11:19:34.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48242025-02-28T11:19:34.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
48252025-02-28T11:19:34.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48262025-02-28T11:19:34.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48272025-02-28T11:19:34.672ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
48282025-02-28T11:19:34.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
48292025-02-28T11:19:34.675ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48302025-02-28T11:19:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
48312025-02-28T11:19:34.677ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
48322025-02-28T11:19:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
48332025-02-28T11:19:34.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48342025-02-28T11:19:34.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48352025-02-28T11:19:34.690ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
48362025-02-28T11:19:34.690ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.710353ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
48372025-02-28T11:19:34.697ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48382025-02-28T11:19:34.697ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48392025-02-28T11:19:34.697ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.504987ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48402025-02-28T11:19:34.697ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48412025-02-28T11:19:34.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48422025-02-28T11:19:34.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 98.785226ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
48432025-02-28T11:19:34.702ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
48442025-02-28T11:19:34.702ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48452025-02-28T11:19:34.703ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcd8b074-1281-4c7a-83d4-e424957f4e4e", "content-length": "26", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
48462025-02-28T11:19:34.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48472025-02-28T11:19:34.703ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.757181ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48482025-02-28T11:19:34.704ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
48492025-02-28T11:19:34.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.705862ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48502025-02-28T11:19:34.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48512025-02-28T11:19:34.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48522025-02-28T11:19:34.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48532025-02-28T11:19:34.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48542025-02-28T11:19:34.714ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
48552025-02-28T11:19:34.714ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 113.829928ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
48562025-02-28T11:19:34.750ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48572025-02-28T11:19:34.751ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "88b21da3-e52d-4576-956f-848c91623375", "content-length": "1", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
48582025-02-28T11:19:34.752ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 158.032524ms iteration = 22 status = {}
48592025-02-28T11:19:34.753ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48602025-02-28T11:19:34.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48612025-02-28T11:19:34.772ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 171.896361ms iteration = 25 status = {"physical_disks_added":0}
48622025-02-28T11:19:34.774ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48632025-02-28T11:19:34.774ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48642025-02-28T11:19:34.774ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5036ee3f-9d71-4052-bd4e-784d3effc89e", "content-length": "372", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
48652025-02-28T11:19:34.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48662025-02-28T11:19:34.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48672025-02-28T11:19:34.776ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 181.670841ms iteration = 22 status = null
48682025-02-28T11:19:34.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48692025-02-28T11:19:34.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48702025-02-28T11:19:34.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48712025-02-28T11:19:34.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48722025-02-28T11:19:34.822ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
48732025-02-28T11:19:34.822ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48742025-02-28T11:19:34.822ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d4f6436a-f299-4c8f-9fe6-601eac746bf0", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
48752025-02-28T11:19:34.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48762025-02-28T11:19:34.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48772025-02-28T11:19:34.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48782025-02-28T11:19:34.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48792025-02-28T11:19:34.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48802025-02-28T11:19:34.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48812025-02-28T11:19:34.830ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48822025-02-28T11:19:34.830ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48832025-02-28T11:19:34.831ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e78e0f05-03a0-4c3a-b46c-db0d49b56877", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
48842025-02-28T11:19:34.832ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 231.737723ms iteration = 22 status = {}
48852025-02-28T11:19:34.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48862025-02-28T11:19:34.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48872025-02-28T11:19:34.841ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
48882025-02-28T11:19:34.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48892025-02-28T11:19:34.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48902025-02-28T11:19:34.851ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48912025-02-28T11:19:34.851ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4391c109-5235-49ae-b685-1ebc55898f88", "content-length": "134", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
48922025-02-28T11:19:34.851ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48932025-02-28T11:19:34.851ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
48942025-02-28T11:19:34.851ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48952025-02-28T11:19:34.851ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48962025-02-28T11:19:34.851ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48972025-02-28T11:19:34.851ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48982025-02-28T11:19:34.851ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48992025-02-28T11:19:34.851ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49002025-02-28T11:19:34.852ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49012025-02-28T11:19:34.852ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49022025-02-28T11:19:34.852ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
49032025-02-28T11:19:34.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49042025-02-28T11:19:34.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49052025-02-28T11:19:34.855ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49062025-02-28T11:19:34.855ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "77ed8d77-329f-4410-879a-e2b60ae56420", "content-length": "2", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
49072025-02-28T11:19:34.855ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49082025-02-28T11:19:34.855ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b0f6f41-e772-493a-9f2d-116348f69334", "content-length": "52", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
49092025-02-28T11:19:34.855ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
49102025-02-28T11:19:34.855ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49112025-02-28T11:19:34.897ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49122025-02-28T11:19:34.958ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7b3db627-87d1-4b9f-906c-d65b541a3948", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
49132025-02-28T11:19:34.958ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
49142025-02-28T11:19:34.958ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49152025-02-28T11:19:34.960ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba95e498-80f7-45b6-9778-172756dd16fe", "content-length": "691", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
49162025-02-28T11:19:34.960ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
49172025-02-28T11:19:34.960ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
49182025-02-28T11:19:34.960ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
49192025-02-28T11:19:34.961ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "699a0b5b-9f1c-48f0-b783-e8cd46755162", "content-length": "682", "date": "Fri, 28 Feb 2025 11:19:34 GMT"} })
49202025-02-28T11:19:34.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49212025-02-28T11:19:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49222025-02-28T11:19:34.962ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 361.930062ms iteration = 22 status = {}
49232025-02-28T11:19:34.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49242025-02-28T11:19:34.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49252025-02-28T11:19:34.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49262025-02-28T11:19:34.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49272025-02-28T11:19:34.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49282025-02-28T11:19:34.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49292025-02-28T11:19:34.979ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 378.526167ms iteration = 22 status = {}
49302025-02-28T11:19:35.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4ec517e8-8283-4908-a068-6a6983603112 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49312025-02-28T11:19:35.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4ec517e8-8283-4908-a068-6a6983603112 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49322025-02-28T11:19:35.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1955 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4ec517e8-8283-4908-a068-6a6983603112 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49332025-02-28T11:19:36.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b7a44b4c-2064-4098-86be-badab3863b52 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49342025-02-28T11:19:36.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b7a44b4c-2064-4098-86be-badab3863b52 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49352025-02-28T11:19:36.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b7a44b4c-2064-4098-86be-badab3863b52 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49362025-02-28T11:19:37.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 569 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 3d552f58-f00e-4fe2-86a6-ece24a681a36 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
49372025-02-28T11:19:37.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2082e81f-13ed-48df-a709-caeec3be2110 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49382025-02-28T11:19:37.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2082e81f-13ed-48df-a709-caeec3be2110 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49392025-02-28T11:19:37.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3242 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2082e81f-13ed-48df-a709-caeec3be2110 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49402025-02-28T11:19:38.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2ddbbd87-f9b8-4d27-bddb-2eec1d755f52 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49412025-02-28T11:19:38.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2ddbbd87-f9b8-4d27-bddb-2eec1d755f52 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49422025-02-28T11:19:38.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3802 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2ddbbd87-f9b8-4d27-bddb-2eec1d755f52 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49432025-02-28T11:19:39.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b7b9381a-3232-4fb1-9e89-742acdf98483 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49442025-02-28T11:19:39.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b7b9381a-3232-4fb1-9e89-742acdf98483 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49452025-02-28T11:19:39.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 10014 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b7b9381a-3232-4fb1-9e89-742acdf98483 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49462025-02-28T11:19:40.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = df0e39d3-0e04-4d97-8321-603a066edaca roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49472025-02-28T11:19:40.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = df0e39d3-0e04-4d97-8321-603a066edaca resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49482025-02-28T11:19:40.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2538 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = df0e39d3-0e04-4d97-8321-603a066edaca response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49492025-02-28T11:19:41.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a254405e-55c4-4486-9f2a-26a76a8813d9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49502025-02-28T11:19:41.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a254405e-55c4-4486-9f2a-26a76a8813d9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49512025-02-28T11:19:41.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a254405e-55c4-4486-9f2a-26a76a8813d9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49522025-02-28T11:19:42.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 562767d2-ba21-46f2-8b4e-fd024746b7ca roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49532025-02-28T11:19:42.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 562767d2-ba21-46f2-8b4e-fd024746b7ca resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49542025-02-28T11:19:42.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 562767d2-ba21-46f2-8b4e-fd024746b7ca response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49552025-02-28T11:19:43.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 72ad5c0e-705a-487a-8eda-dd7d7842fb7b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49562025-02-28T11:19:43.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 72ad5c0e-705a-487a-8eda-dd7d7842fb7b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49572025-02-28T11:19:43.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 72ad5c0e-705a-487a-8eda-dd7d7842fb7b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49582025-02-28T11:19:44.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
49592025-02-28T11:19:44.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49602025-02-28T11:19:44.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49612025-02-28T11:19:44.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
49622025-02-28T11:19:44.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49632025-02-28T11:19:44.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49642025-02-28T11:19:44.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49652025-02-28T11:19:44.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49662025-02-28T11:19:44.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49672025-02-28T11:19:44.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49682025-02-28T11:19:44.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49692025-02-28T11:19:44.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49702025-02-28T11:19:44.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49712025-02-28T11:19:44.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
49722025-02-28T11:19:44.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49732025-02-28T11:19:44.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49742025-02-28T11:19:44.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
49752025-02-28T11:19:44.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.084073ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
49762025-02-28T11:19:44.628ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49772025-02-28T11:19:44.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49782025-02-28T11:19:44.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.448721ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49792025-02-28T11:19:44.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 335be670-9c64-447d-9063-2b825d9db9fa roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49802025-02-28T11:19:44.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 335be670-9c64-447d-9063-2b825d9db9fa resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49812025-02-28T11:19:44.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2649 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 335be670-9c64-447d-9063-2b825d9db9fa response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49822025-02-28T11:19:45.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62828468-84fd-4e4e-ab74-89a97c956949 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49832025-02-28T11:19:45.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62828468-84fd-4e4e-ab74-89a97c956949 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49842025-02-28T11:19:45.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62828468-84fd-4e4e-ab74-89a97c956949 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49852025-02-28T11:19:46.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6e4c801d-db83-4e2f-ab6f-32d74b0ad2e3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49862025-02-28T11:19:46.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6e4c801d-db83-4e2f-ab6f-32d74b0ad2e3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49872025-02-28T11:19:46.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6e4c801d-db83-4e2f-ab6f-32d74b0ad2e3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49882025-02-28T11:19:47.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 606 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = bfd29826-e643-4be5-8ee5-9d0ad434962c response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
49892025-02-28T11:19:47.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 95a189db-9e32-4ee7-ac3a-7c2cc3cf87d4 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49902025-02-28T11:19:47.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 95a189db-9e32-4ee7-ac3a-7c2cc3cf87d4 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49912025-02-28T11:19:47.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 95a189db-9e32-4ee7-ac3a-7c2cc3cf87d4 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49922025-02-28T11:19:48.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dbbdf5ed-1d39-420d-87a1-c31cd5e4396f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49932025-02-28T11:19:48.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dbbdf5ed-1d39-420d-87a1-c31cd5e4396f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49942025-02-28T11:19:48.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dbbdf5ed-1d39-420d-87a1-c31cd5e4396f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
49952025-02-28T11:19:49.082ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 042585ee-9722-4a2d-8977-ab5c6a0ba083 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-02-28T11:19:49.070386637Z }
49962025-02-28T11:19:49.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 042585ee-9722-4a2d-8977-ab5c6a0ba083 roles = RoleSet { roles: {} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
49972025-02-28T11:19:49.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 042585ee-9722-4a2d-8977-ab5c6a0ba083 resource = Database result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
49982025-02-28T11:19:49.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 98037 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 042585ee-9722-4a2d-8977-ab5c6a0ba083 response_code = 204 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
49992025-02-28T11:19:49.169ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2e0f33c2-fc90-42ce-a21b-4078c376013c uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-02-28T11:19:49.169242814Z }
50002025-02-28T11:19:49.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2e0f33c2-fc90-42ce-a21b-4078c376013c roles = RoleSet { roles: {} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50012025-02-28T11:19:49.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2e0f33c2-fc90-42ce-a21b-4078c376013c resource = Database result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50022025-02-28T11:19:49.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 42338 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2e0f33c2-fc90-42ce-a21b-4078c376013c response_code = 204 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50032025-02-28T11:19:49.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f720ca52-0ffc-4b15-85dd-ca0b02a5a47c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50042025-02-28T11:19:49.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f720ca52-0ffc-4b15-85dd-ca0b02a5a47c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50052025-02-28T11:19:49.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f720ca52-0ffc-4b15-85dd-ca0b02a5a47c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50062025-02-28T11:19:51.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 74611a29-2a1c-4f51-8355-f757f1c5d1d5 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50072025-02-28T11:19:51.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 74611a29-2a1c-4f51-8355-f757f1c5d1d5 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50082025-02-28T11:19:51.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 74611a29-2a1c-4f51-8355-f757f1c5d1d5 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50092025-02-28T11:19:52.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bb406fb9-b24e-4088-b29c-6e593c341cef roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50102025-02-28T11:19:52.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bb406fb9-b24e-4088-b29c-6e593c341cef resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50112025-02-28T11:19:52.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1959 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bb406fb9-b24e-4088-b29c-6e593c341cef response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50122025-02-28T11:19:53.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6783c8ef-8c37-40bd-8865-52b0211cde69 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50132025-02-28T11:19:53.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6783c8ef-8c37-40bd-8865-52b0211cde69 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50142025-02-28T11:19:53.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6783c8ef-8c37-40bd-8865-52b0211cde69 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50152025-02-28T11:19:54.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 15665869-2a17-4356-a32b-b6da5cd4e7ba roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50162025-02-28T11:19:54.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 15665869-2a17-4356-a32b-b6da5cd4e7ba resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50172025-02-28T11:19:54.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 15665869-2a17-4356-a32b-b6da5cd4e7ba response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50182025-02-28T11:19:54.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
50192025-02-28T11:19:54.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50202025-02-28T11:19:54.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50212025-02-28T11:19:54.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
50222025-02-28T11:19:54.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50232025-02-28T11:19:54.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50242025-02-28T11:19:54.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50252025-02-28T11:19:54.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50262025-02-28T11:19:54.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50272025-02-28T11:19:54.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50282025-02-28T11:19:54.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50292025-02-28T11:19:54.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50302025-02-28T11:19:54.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50312025-02-28T11:19:54.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
50322025-02-28T11:19:54.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50332025-02-28T11:19:54.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50342025-02-28T11:19:54.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
50352025-02-28T11:19:54.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.13381ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
50362025-02-28T11:19:54.631ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50372025-02-28T11:19:54.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50382025-02-28T11:19:54.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.844673ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50392025-02-28T11:19:55.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c1aff0f7-f708-4b51-bf24-bc0664fb514a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50402025-02-28T11:19:55.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c1aff0f7-f708-4b51-bf24-bc0664fb514a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50412025-02-28T11:19:55.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2815 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c1aff0f7-f708-4b51-bf24-bc0664fb514a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50422025-02-28T11:19:56.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4b64ec90-a42a-46cf-b765-3ac39427b023 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50432025-02-28T11:19:56.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4b64ec90-a42a-46cf-b765-3ac39427b023 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50442025-02-28T11:19:56.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1724 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4b64ec90-a42a-46cf-b765-3ac39427b023 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50452025-02-28T11:19:57.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 632 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = ea5b7645-5020-4a16-ac5b-5442296b6618 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
50462025-02-28T11:19:57.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9b3b22e2-c72e-44a5-bc72-a3a390b3297d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50472025-02-28T11:19:57.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9b3b22e2-c72e-44a5-bc72-a3a390b3297d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50482025-02-28T11:19:57.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2286 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9b3b22e2-c72e-44a5-bc72-a3a390b3297d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50492025-02-28T11:19:58.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a0a6fc17-6a83-4d4e-a420-563dce7bd330 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50502025-02-28T11:19:58.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a0a6fc17-6a83-4d4e-a420-563dce7bd330 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50512025-02-28T11:19:58.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2696 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a0a6fc17-6a83-4d4e-a420-563dce7bd330 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50522025-02-28T11:19:59.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c4f81c6c-ad97-4252-b0f5-49ae46ea2591 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50532025-02-28T11:19:59.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c4f81c6c-ad97-4252-b0f5-49ae46ea2591 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50542025-02-28T11:19:59.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c4f81c6c-ad97-4252-b0f5-49ae46ea2591 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50552025-02-28T11:20:00.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0b15869a-e0c9-4e36-9ac1-d826e5ab108f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50562025-02-28T11:20:00.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0b15869a-e0c9-4e36-9ac1-d826e5ab108f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50572025-02-28T11:20:00.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2716 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0b15869a-e0c9-4e36-9ac1-d826e5ab108f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50582025-02-28T11:20:00.406ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bef4cadb-2dc8-4b4f-b4f7-159d1e9793d1 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-02-28T11:20:00.405937979Z }
50592025-02-28T11:20:00.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bef4cadb-2dc8-4b4f-b4f7-159d1e9793d1 roles = RoleSet { roles: {} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50602025-02-28T11:20:00.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bef4cadb-2dc8-4b4f-b4f7-159d1e9793d1 resource = Database result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50612025-02-28T11:20:00.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 60424 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bef4cadb-2dc8-4b4f-b4f7-159d1e9793d1 response_code = 204 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50622025-02-28T11:20:01.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3d6e6a34-2294-4e74-8bd5-3b87d3cc6725 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50632025-02-28T11:20:01.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3d6e6a34-2294-4e74-8bd5-3b87d3cc6725 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50642025-02-28T11:20:01.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2287 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3d6e6a34-2294-4e74-8bd5-3b87d3cc6725 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50652025-02-28T11:20:02.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = f00625f4-e98f-4968-b9fa-5a81aa918c91 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
50662025-02-28T11:20:02.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = f00625f4-e98f-4968-b9fa-5a81aa918c91 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
50672025-02-28T11:20:02.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2892 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = f00625f4-e98f-4968-b9fa-5a81aa918c91 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
50682025-02-28T11:20:02.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = fd22db5a-e5f5-4bd2-b10c-4a6e062efdaf roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
50692025-02-28T11:20:02.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = fd22db5a-e5f5-4bd2-b10c-4a6e062efdaf resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
50702025-02-28T11:20:02.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = fd22db5a-e5f5-4bd2-b10c-4a6e062efdaf response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
50712025-02-28T11:20:02.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d95347e-12f7-4c5e-a9c9-7f1f2090bbf2 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50722025-02-28T11:20:02.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d95347e-12f7-4c5e-a9c9-7f1f2090bbf2 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50732025-02-28T11:20:02.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2d95347e-12f7-4c5e-a9c9-7f1f2090bbf2 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
50742025-02-28T11:20:02.880ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T11:20:02.879729059Z }
50752025-02-28T11:20:02.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 roles = RoleSet { roles: {} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50762025-02-28T11:20:02.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 resource = Database result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50772025-02-28T11:20:02.897ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e vmm_needs_update = true
50782025-02-28T11:20:02.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 roles = RoleSet { roles: {} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50792025-02-28T11:20:02.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 resource = Database result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50802025-02-28T11:20:02.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 roles = RoleSet { roles: {} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50812025-02-28T11:20:02.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 resource = Database result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50822025-02-28T11:20:02.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 roles = RoleSet { roles: {} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50832025-02-28T11:20:02.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 resource = Database result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50842025-02-28T11:20:02.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 roles = RoleSet { roles: {} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50852025-02-28T11:20:02.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 resource = Database result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50862025-02-28T11:20:02.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 roles = RoleSet { roles: {} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50872025-02-28T11:20:02.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 resource = Database result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50882025-02-28T11:20:02.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 roles = RoleSet { roles: {} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50892025-02-28T11:20:02.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 resource = Database result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50902025-02-28T11:20:02.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50912025-02-28T11:20:02.920ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2a7a83da-ee54-40e9-893a-6d37cebf3833, lookup_type: ById(2a7a83da-ee54-40e9-893a-6d37cebf3833) }, key: 58a566d0-ffd9-4aa8-b8c5-77616a25e87a, lookup_type: ById(58a566d0-ffd9-4aa8-b8c5-77616a25e87a) }, key: 33698fcc-4e6d-4949-8fd8-f637edfc3026, lookup_type: ById(33698fcc-4e6d-4949-8fd8-f637edfc3026) } result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50922025-02-28T11:20:02.927ZINFOnexus (dropshot_internal): starting update saga for 33698fcc-4e6d-4949-8fd8-f637edfc3026 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1545 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T11:20:02.879729059Z }
50932025-02-28T11:20:02.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 52107 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 response_code = 204 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50942025-02-28T11:20:02.932ZDEBGnexus (dropshot_internal): preparing instance-update saga for 33698fcc-4e6d-4949-8fd8-f637edfc3026... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2df3067f-ad5e-4ec9-8a6e-6eceb1359852 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50952025-02-28T11:20:02.932ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update
50962025-02-28T11:20:02.932ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e17c0b28-86ff-4e9e-ac31-072d63dc6d91 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-02-28T11:20:02.879729059Z }
50972025-02-28T11:20:02.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e17c0b28-86ff-4e9e-ac31-072d63dc6d91 roles = RoleSet { roles: {} } uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50982025-02-28T11:20:02.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e17c0b28-86ff-4e9e-ac31-072d63dc6d91 resource = Database result = Ok(()) uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
50992025-02-28T11:20:02.936ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"33698fcc-4e6d-4949-8fd8-f637edfc3026","lookup_type":{"ById":"33698fcc-4e6d-4949-8fd8-f637edfc3026"},"parent":{"key":"58a566d0-ffd9-4aa8-b8c5-77616a25e87a","lookup_type":{"ById":"58a566d0-ffd9-4aa8-b8c5-77616a25e87a"},"parent":{"key":"2a7a83da-ee54-40e9-893a-6d37cebf3833","lookup_type":{"ById":"2a7a83da-ee54-40e9-893a-6d37cebf3833"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51002025-02-28T11:20:02.936ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update
51012025-02-28T11:20:02.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 6488 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e17c0b28-86ff-4e9e-ac31-072d63dc6d91 response_code = 204 uri = /vmms/04f7b38a-fca9-49bc-b85b-42d63919aa2e
51022025-02-28T11:20:02.980ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update
51032025-02-28T11:20:02.980ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51042025-02-28T11:20:02.980ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51052025-02-28T11:20:02.980ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a
51062025-02-28T11:20:02.990ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51072025-02-28T11:20:02.990ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a
51082025-02-28T11:20:02.997ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51092025-02-28T11:20:02.997ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a
51102025-02-28T11:20:03.007ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51112025-02-28T11:20:03.007ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("55fad649-5354-4e02-8d35-9eaa7edad4d8")) node_id = 0 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a
51122025-02-28T11:20:03.011ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51132025-02-28T11:20:03.011ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a
51142025-02-28T11:20:03.029ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update
51152025-02-28T11:20:03.031ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51162025-02-28T11:20:03.031ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51172025-02-28T11:20:03.033ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51182025-02-28T11:20:03.034ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51192025-02-28T11:20:03.035ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51202025-02-28T11:20:03.036ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51212025-02-28T11:20:03.039ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51222025-02-28T11:20:03.040ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51232025-02-28T11:20:03.041ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51242025-02-28T11:20:03.041ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51252025-02-28T11:20:03.042ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51262025-02-28T11:20:03.043ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51272025-02-28T11:20:03.044ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51282025-02-28T11:20:03.050ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2a7a83da-ee54-40e9-893a-6d37cebf3833, lookup_type: ById(2a7a83da-ee54-40e9-893a-6d37cebf3833) }, key: 58a566d0-ffd9-4aa8-b8c5-77616a25e87a, lookup_type: ById(58a566d0-ffd9-4aa8-b8c5-77616a25e87a) }, key: 33698fcc-4e6d-4949-8fd8-f637edfc3026, lookup_type: ById(33698fcc-4e6d-4949-8fd8-f637edfc3026) } result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51292025-02-28T11:20:03.050ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance updater_id = 55fad649-5354-4e02-8d35-9eaa7edad4d8
51302025-02-28T11:20:03.050ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51312025-02-28T11:20:03.050ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51322025-02-28T11:20:03.070ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance updater_id = 55fad649-5354-4e02-8d35-9eaa7edad4d8
51332025-02-28T11:20:03.070ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51342025-02-28T11:20:03.070ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance
51352025-02-28T11:20:03.077ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 locked_gen = Generation(Generation(2)) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = LockInstance updater_id = 55fad649-5354-4e02-8d35-9eaa7edad4d8
51362025-02-28T11:20:03.077ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51372025-02-28T11:20:03.077ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("55fad649-5354-4e02-8d35-9eaa7edad4d8")}) node_id = 1 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a
51382025-02-28T11:20:03.086ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51392025-02-28T11:20:03.086ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a
51402025-02-28T11:20:03.097ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51412025-02-28T11:20:03.097ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51422025-02-28T11:20:03.099ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51432025-02-28T11:20:03.099ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51442025-02-28T11:20:03.100ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51452025-02-28T11:20:03.100ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51462025-02-28T11:20:03.102ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51472025-02-28T11:20:03.105ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2a7a83da-ee54-40e9-893a-6d37cebf3833, lookup_type: ById(2a7a83da-ee54-40e9-893a-6d37cebf3833) }, key: 58a566d0-ffd9-4aa8-b8c5-77616a25e87a, lookup_type: ById(58a566d0-ffd9-4aa8-b8c5-77616a25e87a) }, key: 33698fcc-4e6d-4949-8fd8-f637edfc3026, lookup_type: ById(33698fcc-4e6d-4949-8fd8-f637edfc3026) } result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51482025-02-28T11:20:03.105ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51492025-02-28T11:20:03.105ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
51502025-02-28T11:20:03.112ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 04f7b38a-fca9-49bc-b85b-42d63919aa2e, time_created: 2025-02-28T11:19:36.719972Z, time_deleted: None, instance_id: 33698fcc-4e6d-4949-8fd8-f637edfc3026, sled_id: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-02-28T11:20:02.879729Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-02-28T11:19:33.264423Z, gen: Generation(Generation(3)), propolis_id: Some(04f7b38a-fca9-49bc-b85b-42d63919aa2e), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(04f7b38a-fca9-49bc-b85b-42d63919aa2e (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-02-28T11:20:03.110377419Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
51512025-02-28T11:20:03.115ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
51522025-02-28T11:20:03.117ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"33698fcc-4e6d-4949-8fd8-f637edfc3026","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"04f7b38a-fca9-49bc-b85b-42d63919aa2e"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"33698fcc-4e6d-4949-8fd8-f637edfc3026","lookup_type":{"ById":"33698fcc-4e6d-4949-8fd8-f637edfc3026"},"parent":{"key":"58a566d0-ffd9-4aa8-b8c5-77616a25e87a","lookup_type":{"ById":"58a566d0-ffd9-4aa8-b8c5-77616a25e87a"},"parent":{"key":"2a7a83da-ee54-40e9-893a-6d37cebf3833","lookup_type":{"ById":"2a7a83da-ee54-40e9-893a-6d37cebf3833"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"55fad649-5354-4e02-8d35-9eaa7edad4d8"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"58a566d0-ffd9-4aa8-b8c5-77616a25e87a","ram_diff":1073741824},"destroy_active_vmm":"04f7b38a-fca9-49bc-b85b-42d63919aa2e","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-02-28T11:20:03.110377419Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51532025-02-28T11:20:03.117ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
51542025-02-28T11:20:03.126ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
51552025-02-28T11:20:03.126ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51562025-02-28T11:20:03.126ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51572025-02-28T11:20:03.126ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
51582025-02-28T11:20:03.131ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51592025-02-28T11:20:03.131ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
51602025-02-28T11:20:03.137ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51612025-02-28T11:20:03.137ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
51622025-02-28T11:20:03.142ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51632025-02-28T11:20:03.142ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3a83cf1f-c5f4-40a1-b1a4-09bc06472f18")) node_id = 0 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
51642025-02-28T11:20:03.147ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51652025-02-28T11:20:03.147ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
51662025-02-28T11:20:03.157ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 parent_lock = UpdaterLock { updater_id: 55fad649-5354-4e02-8d35-9eaa7edad4d8, locked_gen: Generation(Generation(2)) } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
51672025-02-28T11:20:03.157ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = BecomeUpdater
51682025-02-28T11:20:03.158ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = BecomeUpdater
51692025-02-28T11:20:03.176ZDEBGnexus (SagaExecutor): inherited lock from 55fad649-5354-4e02-8d35-9eaa7edad4d8 to 3a83cf1f-c5f4-40a1-b1a4-09bc06472f18 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 55fad649-5354-4e02-8d35-9eaa7edad4d8 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = BecomeUpdater updater_id = 3a83cf1f-c5f4-40a1-b1a4-09bc06472f18
51702025-02-28T11:20:03.176ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
51712025-02-28T11:20:03.176ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51722025-02-28T11:20:03.176ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("3a83cf1f-c5f4-40a1-b1a4-09bc06472f18")}) node_id = 1 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
51732025-02-28T11:20:03.181ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51742025-02-28T11:20:03.181ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
51752025-02-28T11:20:03.188ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51762025-02-28T11:20:03.188ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
51772025-02-28T11:20:03.192ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
51782025-02-28T11:20:03.192ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
51792025-02-28T11:20:03.200ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
51802025-02-28T11:20:03.202ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026
51812025-02-28T11:20:03.204ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = UpdateNetworkConfig
51822025-02-28T11:20:03.205ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = UpdateNetworkConfig
51832025-02-28T11:20:03.207ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = UpdateNetworkConfig
51842025-02-28T11:20:03.207ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = UpdateNetworkConfig
51852025-02-28T11:20:03.209ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
51862025-02-28T11:20:03.209ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = UpdateNetworkConfig
51872025-02-28T11:20:03.209ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = UpdateNetworkConfig
51882025-02-28T11:20:03.211ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
51892025-02-28T11:20:03.211ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
51902025-02-28T11:20:03.211ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
51912025-02-28T11:20:03.212ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
51922025-02-28T11:20:03.213ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
51932025-02-28T11:20:03.213ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
51942025-02-28T11:20:03.214ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
51952025-02-28T11:20:03.218ZDEBGnexus: notifying dendrite of updates instance_id = Some(33698fcc-4e6d-4949-8fd8-f637edfc3026 (instance)) switch = switch0
51962025-02-28T11:20:03.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1771, tv_nsec: 768425545 } })
51972025-02-28T11:20:03.218ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1155
51982025-02-28T11:20:03.249ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
51992025-02-28T11:20:03.249ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52002025-02-28T11:20:03.249ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2efb0fd5-0931-407f-8902-436f67a65303", "content-length": "26", "date": "Fri, 28 Feb 2025 11:20:03 GMT"} })
52012025-02-28T11:20:03.249ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52022025-02-28T11:20:03.250ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52032025-02-28T11:20:03.279ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
52042025-02-28T11:20:03.279ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "a864a7c5-6819-4355-92b8-92a9c8343354", "content-length": "4", "date": "Fri, 28 Feb 2025 11:20:02 GMT"} })
52052025-02-28T11:20:03.281ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52062025-02-28T11:20:03.281ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52072025-02-28T11:20:03.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6c598388-f0a4-4823-bc60-a82d80bf4216 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
52082025-02-28T11:20:03.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6c598388-f0a4-4823-bc60-a82d80bf4216 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
52092025-02-28T11:20:03.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1583 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6c598388-f0a4-4823-bc60-a82d80bf4216 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
52102025-02-28T11:20:03.295ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52112025-02-28T11:20:03.295ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52122025-02-28T11:20:03.307ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
52132025-02-28T11:20:03.307ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
52142025-02-28T11:20:03.326ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-02-28T11:20:03.310607Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, time_modified: Some(2025-02-28T11:20:03.310607Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 58a566d0-ffd9-4aa8-b8c5-77616a25e87a, time_modified: Some(2025-02-28T11:20:03.310607Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
52152025-02-28T11:20:03.326ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52162025-02-28T11:20:03.326ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52172025-02-28T11:20:03.333ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52182025-02-28T11:20:03.333ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52192025-02-28T11:20:03.340ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
52202025-02-28T11:20:03.340ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = UnassignOximeterProducer
52212025-02-28T11:20:03.340ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = UnassignOximeterProducer
52222025-02-28T11:20:03.349ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 59e12d21-f0a8-4840-9b1a-87533ec59eae producer_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
52232025-02-28T11:20:03.349ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = UnassignOximeterProducer
52242025-02-28T11:20:03.349ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = UnassignOximeterProducer
52252025-02-28T11:20:03.384ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
52262025-02-28T11:20:03.384ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/33698fcc-4e6d-4949-8fd8-f637edfc3026
52272025-02-28T11:20:03.394ZDEBGnexus (SagaExecutor): client response oximeter-collector = 33698fcc-4e6d-4949-8fd8-f637edfc3026 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/33698fcc-4e6d-4949-8fd8-f637edfc3026", status: 204, headers: {"x-request-id": "46504907-a0e3-43c0-839e-5dc7a1fa5bcf", "date": "Fri, 28 Feb 2025 11:20:03 GMT"} }) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
52282025-02-28T11:20:03.394ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 59e12d21-f0a8-4840-9b1a-87533ec59eae producer_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
52292025-02-28T11:20:03.395ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52302025-02-28T11:20:03.395ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52312025-02-28T11:20:03.401ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52322025-02-28T11:20:03.401ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52332025-02-28T11:20:03.405ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 lock = UpdaterLock { updater_id: 3a83cf1f-c5f4-40a1-b1a4-09bc06472f18, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-02-28T11:20:03.110377419Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
52342025-02-28T11:20:03.405ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = CommitInstanceUpdates
52352025-02-28T11:20:03.406ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = CommitInstanceUpdates
52362025-02-28T11:20:03.467ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 new_runtime = InstanceRuntimeState { time_updated: 2025-02-28T11:20:03.110377419Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
52372025-02-28T11:20:03.467ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52382025-02-28T11:20:03.467ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52392025-02-28T11:20:03.467ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Signaled
52402025-02-28T11:20:03.467ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Signaled
52412025-02-28T11:20:03.467ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52422025-02-28T11:20:03.467ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52432025-02-28T11:20:03.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52442025-02-28T11:20:03.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52452025-02-28T11:20:03.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52462025-02-28T11:20:03.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52472025-02-28T11:20:03.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52482025-02-28T11:20:03.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52492025-02-28T11:20:03.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52502025-02-28T11:20:03.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52512025-02-28T11:20:03.475ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52522025-02-28T11:20:03.475ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52532025-02-28T11:20:03.475ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52542025-02-28T11:20:03.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52552025-02-28T11:20:03.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52562025-02-28T11:20:03.481ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52572025-02-28T11:20:03.481ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("33698fcc-4e6d-4949-8fd8-f637edfc3026"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("04f7b38a-fca9-49bc-b85b-42d63919aa2e")}) node_id = 7 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52582025-02-28T11:20:03.494ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52592025-02-28T11:20:03.494ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52602025-02-28T11:20:03.503ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52612025-02-28T11:20:03.503ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52622025-02-28T11:20:03.509ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
52632025-02-28T11:20:03.509ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52642025-02-28T11:20:03.510ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0379ea44-3968-418b-949d-8ca0d5f8d336", "content-length": "372", "date": "Fri, 28 Feb 2025 11:20:03 GMT"} })
52652025-02-28T11:20:03.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52662025-02-28T11:20:03.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52672025-02-28T11:20:03.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52682025-02-28T11:20:03.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52692025-02-28T11:20:03.513ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52702025-02-28T11:20:03.513ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52712025-02-28T11:20:03.521ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
52722025-02-28T11:20:03.521ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ReleaseSledResources
52732025-02-28T11:20:03.521ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ReleaseSledResources
52742025-02-28T11:20:03.547ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52752025-02-28T11:20:03.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52762025-02-28T11:20:03.548ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52772025-02-28T11:20:03.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52782025-02-28T11:20:03.550ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52792025-02-28T11:20:03.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52802025-02-28T11:20:03.552ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52812025-02-28T11:20:03.552ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {55df1394-1be9-4232-9b7c-b1bb985e4810: {10.151.1.176: {731aab52-950d-43e3-bf3d-72f8aef44969}, 10.151.1.175: {731aab52-950d-43e3-bf3d-72f8aef44969}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
52822025-02-28T11:20:03.552ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52832025-02-28T11:20:03.552ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
52842025-02-28T11:20:03.552ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d64c75a4-7f22-4d35-b8bb-1a45c1ea5ae4", "date": "Fri, 28 Feb 2025 11:20:03 GMT"} })
52852025-02-28T11:20:03.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52862025-02-28T11:20:03.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52872025-02-28T11:20:03.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52882025-02-28T11:20:03.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52892025-02-28T11:20:03.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52902025-02-28T11:20:03.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52912025-02-28T11:20:03.559ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52922025-02-28T11:20:03.559ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52932025-02-28T11:20:03.559ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9dda627f-9fda-439d-9bfb-5d7b3a0421b1", "date": "Fri, 28 Feb 2025 11:20:03 GMT"} })
52942025-02-28T11:20:03.561ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 93.82805ms iteration = 23 status = {}
52952025-02-28T11:20:03.570ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
52962025-02-28T11:20:03.570ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
52972025-02-28T11:20:03.577ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 propolis_id = 04f7b38a-fca9-49bc-b85b-42d63919aa2e saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
52982025-02-28T11:20:03.577ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = MarkVmmDeleted
52992025-02-28T11:20:03.578ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = MarkVmmDeleted
53002025-02-28T11:20:03.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53012025-02-28T11:20:03.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53022025-02-28T11:20:03.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53032025-02-28T11:20:03.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53042025-02-28T11:20:03.592ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53052025-02-28T11:20:03.592ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
53062025-02-28T11:20:03.603ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53072025-02-28T11:20:03.603ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
53082025-02-28T11:20:03.614ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53092025-02-28T11:20:03.614ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
53102025-02-28T11:20:03.618ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53112025-02-28T11:20:03.618ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "46b2de49-b23f-4e02-8aca-2837055499f6", "content-length": "691", "date": "Fri, 28 Feb 2025 11:20:03 GMT"} })
53122025-02-28T11:20:03.618ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
53132025-02-28T11:20:03.618ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
53142025-02-28T11:20:03.618ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
53152025-02-28T11:20:03.619ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53162025-02-28T11:20:03.619ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
53172025-02-28T11:20:03.619ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 152.627879ms iteration = 23 status = {}
53182025-02-28T11:20:03.626ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ChainSuccessorSaga
53192025-02-28T11:20:03.626ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ChainSuccessorSaga
53202025-02-28T11:20:03.628ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ChainSuccessorSaga
53212025-02-28T11:20:03.628ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ChainSuccessorSaga
53222025-02-28T11:20:03.630ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ChainSuccessorSaga
53232025-02-28T11:20:03.630ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ChainSuccessorSaga
53242025-02-28T11:20:03.631ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ChainSuccessorSaga
53252025-02-28T11:20:03.635ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2a7a83da-ee54-40e9-893a-6d37cebf3833, lookup_type: ById(2a7a83da-ee54-40e9-893a-6d37cebf3833) }, key: 58a566d0-ffd9-4aa8-b8c5-77616a25e87a, lookup_type: ById(58a566d0-ffd9-4aa8-b8c5-77616a25e87a) }, key: 33698fcc-4e6d-4949-8fd8-f637edfc3026, lookup_type: ById(33698fcc-4e6d-4949-8fd8-f637edfc3026) } result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ChainSuccessorSaga
53262025-02-28T11:20:03.635ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ChainSuccessorSaga
53272025-02-28T11:20:03.635ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_node = ChainSuccessorSaga
53282025-02-28T11:20:03.640ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 karmic_state = WillReincarnate needs_reincarnation = false saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update
53292025-02-28T11:20:03.640ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53302025-02-28T11:20:03.640ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
53312025-02-28T11:20:03.645ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53322025-02-28T11:20:03.645ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
53332025-02-28T11:20:03.652ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53342025-02-28T11:20:03.652ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
53352025-02-28T11:20:03.656ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53362025-02-28T11:20:03.656ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9
53372025-02-28T11:20:03.667ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53382025-02-28T11:20:03.669ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 saga_name = instance-update saga_result = SagaResult { saga_id: a852df0f-82ab-406b-9b44-e969987f0dc9, saga_log: SagaLog { saga_id: a852df0f-82ab-406b-9b44-e969987f0dc9, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("3a83cf1f-c5f4-40a1-b1a4-09bc06472f18")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("3a83cf1f-c5f4-40a1-b1a4-09bc06472f18")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("33698fcc-4e6d-4949-8fd8-f637edfc3026"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("04f7b38a-fca9-49bc-b85b-42d63919aa2e")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("33698fcc-4e6d-4949-8fd8-f637edfc3026"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("04f7b38a-fca9-49bc-b85b-42d63919aa2e")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("3a83cf1f-c5f4-40a1-b1a4-09bc06472f18"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("3a83cf1f-c5f4-40a1-b1a4-09bc06472f18")}} }) }
53392025-02-28T11:20:03.669ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = a852df0f-82ab-406b-9b44-e969987f0dc9 instance_id = 33698fcc-4e6d-4949-8fd8-f637edfc3026 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update
53402025-02-28T11:20:03.669ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53412025-02-28T11:20:03.669ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a
53422025-02-28T11:20:03.677ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53432025-02-28T11:20:03.677ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a
53442025-02-28T11:20:03.682ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53452025-02-28T11:20:03.682ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a
53462025-02-28T11:20:03.689ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53472025-02-28T11:20:03.689ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a
53482025-02-28T11:20:03.728ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update sec_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
53492025-02-28T11:20:03.728ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 1282fd74-7933-4269-91a7-8cce9f81202a saga_name = start-instance-update saga_result = SagaResult { saga_id: 1282fd74-7933-4269-91a7-8cce9f81202a, saga_log: SagaLog { saga_id: 1282fd74-7933-4269-91a7-8cce9f81202a, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("55fad649-5354-4e02-8d35-9eaa7edad4d8")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("55fad649-5354-4e02-8d35-9eaa7edad4d8")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("55fad649-5354-4e02-8d35-9eaa7edad4d8"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("55fad649-5354-4e02-8d35-9eaa7edad4d8")}} }) }
53502025-02-28T11:20:04.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f95d2a4b-480a-4780-8991-6b2463269cc8 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
53512025-02-28T11:20:04.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f95d2a4b-480a-4780-8991-6b2463269cc8 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
53522025-02-28T11:20:04.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2243 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f95d2a4b-480a-4780-8991-6b2463269cc8 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
53532025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
53542025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53552025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
53562025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53572025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53582025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
53592025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
53602025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53612025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
53622025-02-28T11:20:04.595ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-28 11:10:04.595813390 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
53632025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53642025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
53652025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
53662025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
53672025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53682025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
53692025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
53702025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53712025-02-28T11:20:04.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53722025-02-28T11:20:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53732025-02-28T11:20:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53742025-02-28T11:20:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53752025-02-28T11:20:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53762025-02-28T11:20:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53772025-02-28T11:20:04.596ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cd949b0-a160-497e-a9d3-708f380c3425.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 146094369 } })
53782025-02-28T11:20:04.596ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c58b6d59-7cb2-478f-9d27-4e70c13f0853.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("daf1508c-21c6-4c2b-91a0-3e717092a118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 146140190 } })
53792025-02-28T11:20:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53802025-02-28T11:20:04.596ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
53812025-02-28T11:20:04.596ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
53822025-02-28T11:20:04.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 977.281\u{b5}s iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
53832025-02-28T11:20:04.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53842025-02-28T11:20:04.597ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
53852025-02-28T11:20:04.597ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.262877ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
53862025-02-28T11:20:04.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53872025-02-28T11:20:04.599ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-28 11:10:04.595813390 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53882025-02-28T11:20:04.599ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.499035ms iteration = 12 status = {"expiration":"2025-02-28T11:10:04.595813390Z","pruned":[]}
53892025-02-28T11:20:04.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 149279097 } })
53902025-02-28T11:20:04.599ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
53912025-02-28T11:20:04.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53922025-02-28T11:20:04.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53932025-02-28T11:20:04.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
53942025-02-28T11:20:04.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53952025-02-28T11:20:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53962025-02-28T11:20:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53972025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
53982025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
53992025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54002025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
54012025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
54022025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
54032025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
54042025-02-28T11:20:04.601ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
54052025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54062025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
54072025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
54082025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
54092025-02-28T11:20:04.601ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 7549b177-a582-4102-91fb-b7e6324fd615
54102025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54112025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54122025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 31.141\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"7549b177-a582-4102-91fb-b7e6324fd615"}
54132025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
54142025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
54152025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54162025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54172025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
54182025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54192025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54202025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
54212025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54222025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
54232025-02-28T11:20:04.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54242025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54252025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
54262025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54272025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
54282025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
54292025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
54302025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54312025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
54322025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54332025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
54342025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54352025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
54362025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54372025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
54382025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54392025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
54402025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54412025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
54422025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
54432025-02-28T11:20:04.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 151570586 } })
54442025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54452025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54462025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54472025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54482025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54492025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54502025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54512025-02-28T11:20:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54522025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
54532025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54542025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54552025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54562025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54572025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54582025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54592025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54602025-02-28T11:20:04.602ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
54612025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54622025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54632025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54642025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54652025-02-28T11:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54662025-02-28T11:20:04.603ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.812536ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54672025-02-28T11:20:04.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54682025-02-28T11:20:04.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54692025-02-28T11:20:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54702025-02-28T11:20:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54712025-02-28T11:20:04.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54722025-02-28T11:20:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54732025-02-28T11:20:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54742025-02-28T11:20:04.608ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.194534ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
54752025-02-28T11:20:04.608ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54762025-02-28T11:20:04.609ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54772025-02-28T11:20:04.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54782025-02-28T11:20:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
54792025-02-28T11:20:04.611ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54802025-02-28T11:20:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54812025-02-28T11:20:04.611ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54822025-02-28T11:20:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54832025-02-28T11:20:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54842025-02-28T11:20:04.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54852025-02-28T11:20:04.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54862025-02-28T11:20:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54872025-02-28T11:20:04.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54882025-02-28T11:20:04.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54892025-02-28T11:20:04.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54902025-02-28T11:20:04.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54912025-02-28T11:20:04.615ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54922025-02-28T11:20:04.615ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54932025-02-28T11:20:04.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54942025-02-28T11:20:04.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54952025-02-28T11:20:04.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54962025-02-28T11:20:04.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 17.103517ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
54972025-02-28T11:20:04.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54982025-02-28T11:20:04.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54992025-02-28T11:20:04.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55002025-02-28T11:20:04.622ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55012025-02-28T11:20:04.623ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55022025-02-28T11:20:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55032025-02-28T11:20:04.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55042025-02-28T11:20:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
55052025-02-28T11:20:04.624ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55062025-02-28T11:20:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55072025-02-28T11:20:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55082025-02-28T11:20:04.624ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55092025-02-28T11:20:04.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55102025-02-28T11:20:04.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55112025-02-28T11:20:04.628ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55122025-02-28T11:20:04.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55132025-02-28T11:20:04.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55142025-02-28T11:20:04.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55152025-02-28T11:20:04.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55162025-02-28T11:20:04.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55172025-02-28T11:20:04.635ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 184745417 } })
55182025-02-28T11:20:04.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
55192025-02-28T11:20:04.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55202025-02-28T11:20:04.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55212025-02-28T11:20:04.635ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
55222025-02-28T11:20:04.648ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55232025-02-28T11:20:04.648ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 46.885314ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55242025-02-28T11:20:04.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55252025-02-28T11:20:04.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55262025-02-28T11:20:04.663ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
55272025-02-28T11:20:04.663ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55282025-02-28T11:20:04.663ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55292025-02-28T11:20:04.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55302025-02-28T11:20:04.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55312025-02-28T11:20:04.664ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55322025-02-28T11:20:04.664ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55332025-02-28T11:20:04.664ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55342025-02-28T11:20:04.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55352025-02-28T11:20:04.664ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
55362025-02-28T11:20:04.664ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
55372025-02-28T11:20:04.664ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.340106ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
55382025-02-28T11:20:04.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55392025-02-28T11:20:04.670ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55402025-02-28T11:20:04.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55412025-02-28T11:20:04.674ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 72.985783ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
55422025-02-28T11:20:04.675ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55432025-02-28T11:20:04.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55442025-02-28T11:20:04.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55452025-02-28T11:20:04.678ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.866677ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
55462025-02-28T11:20:04.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55472025-02-28T11:20:04.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55482025-02-28T11:20:04.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55492025-02-28T11:20:04.681ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55502025-02-28T11:20:04.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55512025-02-28T11:20:04.681ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55522025-02-28T11:20:04.681ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55532025-02-28T11:20:04.682ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55542025-02-28T11:20:04.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55552025-02-28T11:20:04.682ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55562025-02-28T11:20:04.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55572025-02-28T11:20:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55582025-02-28T11:20:04.686ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
55592025-02-28T11:20:04.686ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
55602025-02-28T11:20:04.686ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.255186ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
55612025-02-28T11:20:04.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
55622025-02-28T11:20:04.687ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55632025-02-28T11:20:04.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55642025-02-28T11:20:04.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.190429ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55652025-02-28T11:20:04.719ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55662025-02-28T11:20:04.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55672025-02-28T11:20:04.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55682025-02-28T11:20:04.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55692025-02-28T11:20:04.747ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55702025-02-28T11:20:04.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
55712025-02-28T11:20:04.761ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55722025-02-28T11:20:04.761ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bcb91d5-4cf5-496a-be75-67bcc85f3f4e", "content-length": "26", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
55732025-02-28T11:20:04.761ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55742025-02-28T11:20:04.762ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55752025-02-28T11:20:04.863ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
55762025-02-28T11:20:04.863ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55772025-02-28T11:20:04.863ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a096c2ee-c9b9-4b8d-92dc-83979423beeb", "content-length": "26", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
55782025-02-28T11:20:04.863ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55792025-02-28T11:20:04.864ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55802025-02-28T11:20:04.865ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55812025-02-28T11:20:04.923ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55822025-02-28T11:20:04.923ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "54a6862d-49fd-4b14-aaf5-a34885d58f64", "content-length": "2", "date": "Fri, 28 Feb 2025 11:20:03 GMT"} })
55832025-02-28T11:20:04.925ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55842025-02-28T11:20:04.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55852025-02-28T11:20:04.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
55862025-02-28T11:20:04.928ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55872025-02-28T11:20:04.929ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f5a5098-712f-494f-8ed0-82768304da60", "content-length": "26", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
55882025-02-28T11:20:04.929ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55892025-02-28T11:20:04.930ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
55902025-02-28T11:20:04.939ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55912025-02-28T11:20:04.939ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55922025-02-28T11:20:04.940ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "497a7b53-d157-40c8-bab3-3b178c0cacdd", "content-length": "372", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
55932025-02-28T11:20:04.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55942025-02-28T11:20:04.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55952025-02-28T11:20:04.944ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55962025-02-28T11:20:04.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55972025-02-28T11:20:04.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55982025-02-28T11:20:04.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55992025-02-28T11:20:04.948ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 352.50518ms iteration = 23 status = null
56002025-02-28T11:20:04.951ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
56012025-02-28T11:20:04.951ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 351.528289ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
56022025-02-28T11:20:04.965ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
56032025-02-28T11:20:04.965ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "24160599-806a-40cc-9bcb-0c0962d7bc82", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
56042025-02-28T11:20:04.965ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
56052025-02-28T11:20:04.968ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6e63f436-e09b-46fa-b1b1-800ba5852b33", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
56062025-02-28T11:20:04.968ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
56072025-02-28T11:20:04.969ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
56082025-02-28T11:20:04.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 374.150413ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
56092025-02-28T11:20:04.981ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56102025-02-28T11:20:04.981ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56112025-02-28T11:20:04.981ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 379.812565ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56122025-02-28T11:20:04.982ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56132025-02-28T11:20:04.983ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 381.529051ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56142025-02-28T11:20:04.983ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56152025-02-28T11:20:04.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56162025-02-28T11:20:04.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
56172025-02-28T11:20:04.984ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56182025-02-28T11:20:04.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56192025-02-28T11:20:04.987ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 386.108809ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56202025-02-28T11:20:04.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56212025-02-28T11:20:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56222025-02-28T11:20:04.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56232025-02-28T11:20:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56242025-02-28T11:20:04.992ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56252025-02-28T11:20:04.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56262025-02-28T11:20:04.993ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56272025-02-28T11:20:04.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56282025-02-28T11:20:04.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56292025-02-28T11:20:04.995ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56302025-02-28T11:20:04.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56312025-02-28T11:20:04.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56322025-02-28T11:20:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56332025-02-28T11:20:04.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56342025-02-28T11:20:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56352025-02-28T11:20:04.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56362025-02-28T11:20:04.997ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56372025-02-28T11:20:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56382025-02-28T11:20:05.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56392025-02-28T11:20:05.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
56402025-02-28T11:20:05.004ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56412025-02-28T11:20:05.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56422025-02-28T11:20:05.007ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 405.850932ms iteration = 23 status = 0
56432025-02-28T11:20:05.008ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
56442025-02-28T11:20:05.008ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56452025-02-28T11:20:05.009ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "558db92f-2022-4f57-af9c-3a5381090f89", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
56462025-02-28T11:20:05.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56472025-02-28T11:20:05.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56482025-02-28T11:20:05.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56492025-02-28T11:20:05.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56502025-02-28T11:20:05.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 416.285675ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
56512025-02-28T11:20:05.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56522025-02-28T11:20:05.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56532025-02-28T11:20:05.023ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
56542025-02-28T11:20:05.025ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56552025-02-28T11:20:05.025ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56562025-02-28T11:20:05.026ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a6067f6c-19ce-4393-940a-45b7e8d77fdc", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
56572025-02-28T11:20:05.027ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
56582025-02-28T11:20:05.027ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
56592025-02-28T11:20:05.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56602025-02-28T11:20:05.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56612025-02-28T11:20:05.028ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
56622025-02-28T11:20:05.028ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 426.972214ms iteration = 24 status = {}
56632025-02-28T11:20:05.028ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 427.120648ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
56642025-02-28T11:20:05.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56652025-02-28T11:20:05.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56662025-02-28T11:20:05.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56672025-02-28T11:20:05.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56682025-02-28T11:20:05.034ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
56692025-02-28T11:20:05.034ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56702025-02-28T11:20:05.034ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-28 11:09:18.396893 UTC dns_group = internal generation = 1
56712025-02-28T11:20:05.034ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 438.672075ms iteration = 12 status = {"generation":1}
56722025-02-28T11:20:05.039ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-28T11:09:02.015184Z, time_modified: 2025-02-28T11:09:02.015184Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
56732025-02-28T11:20:05.039ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 444.00625ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]}},"default_endpoint":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
56742025-02-28T11:20:05.042ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
56752025-02-28T11:20:05.042ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 0 version = 2
56762025-02-28T11:20:05.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56772025-02-28T11:20:05.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56782025-02-28T11:20:05.043ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 447.414542ms iteration = 23 status = {}
56792025-02-28T11:20:05.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56802025-02-28T11:20:05.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56812025-02-28T11:20:05.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56822025-02-28T11:20:05.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56832025-02-28T11:20:05.055ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 1 version = 2
56842025-02-28T11:20:05.055ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
56852025-02-28T11:20:05.055ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-28 11:09:19.025515 UTC dns_group = external generation = 2
56862025-02-28T11:20:05.055ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 459.91529ms iteration = 12 status = {"generation":2}
56872025-02-28T11:20:05.068ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
56882025-02-28T11:20:05.068ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 466.965561ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
56892025-02-28T11:20:05.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56902025-02-28T11:20:05.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56912025-02-28T11:20:05.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56922025-02-28T11:20:05.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56932025-02-28T11:20:05.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56942025-02-28T11:20:05.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56952025-02-28T11:20:05.105ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 504.028844ms iteration = 26 status = {"physical_disks_added":0}
56962025-02-28T11:20:05.105ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
56972025-02-28T11:20:05.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56982025-02-28T11:20:05.106ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f2e875f9-beab-4e31-afe9-6c47b310f576", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56992025-02-28T11:20:05.106ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57002025-02-28T11:20:05.107ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57012025-02-28T11:20:05.107ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "cfe73faa-546e-427b-bd37-ade83c1536c9", "date": "Fri, 28 Feb 2025 11:20:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57022025-02-28T11:20:05.107ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57032025-02-28T11:20:05.107ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57042025-02-28T11:20:05.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57052025-02-28T11:20:05.109ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "65c735a3-a3d1-4e47-8e95-70feaa454857", "date": "Fri, 28 Feb 2025 11:20:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57062025-02-28T11:20:05.109ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57072025-02-28T11:20:05.111ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
57082025-02-28T11:20:05.111ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 515.338277ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
57092025-02-28T11:20:05.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57102025-02-28T11:20:05.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57112025-02-28T11:20:05.155ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
57122025-02-28T11:20:05.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57132025-02-28T11:20:05.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57142025-02-28T11:20:05.163ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57152025-02-28T11:20:05.163ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3484dd89-4dbe-40ee-874a-f43e49cc914e", "content-length": "691", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
57162025-02-28T11:20:05.163ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
57172025-02-28T11:20:05.163ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
57182025-02-28T11:20:05.163ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
57192025-02-28T11:20:05.164ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 563.005768ms iteration = 24 status = {}
57202025-02-28T11:20:05.165ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57212025-02-28T11:20:05.165ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb4744ea-b36c-4b50-b782-53928b30728d", "content-length": "134", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
57222025-02-28T11:20:05.165ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57232025-02-28T11:20:05.165ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
57242025-02-28T11:20:05.165ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57252025-02-28T11:20:05.165ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57262025-02-28T11:20:05.165ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57272025-02-28T11:20:05.165ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57282025-02-28T11:20:05.165ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57292025-02-28T11:20:05.165ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57302025-02-28T11:20:05.166ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57312025-02-28T11:20:05.166ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57322025-02-28T11:20:05.166ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
57332025-02-28T11:20:05.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57342025-02-28T11:20:05.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57352025-02-28T11:20:05.168ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57362025-02-28T11:20:05.168ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "210da3c2-6ed5-4a7c-8589-752f732d4232", "content-length": "2", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
57372025-02-28T11:20:05.168ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57382025-02-28T11:20:05.168ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cca5b3a-8236-49ca-9f63-a82192ef17f0", "content-length": "52", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
57392025-02-28T11:20:05.168ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
57402025-02-28T11:20:05.168ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57412025-02-28T11:20:05.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "250ad696-3b08-4024-89c4-63cec5463894", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
57422025-02-28T11:20:05.258ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
57432025-02-28T11:20:05.258ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57442025-02-28T11:20:05.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1619e68-425d-464f-814c-d02c8018f542", "content-length": "682", "date": "Fri, 28 Feb 2025 11:20:04 GMT"} })
57452025-02-28T11:20:05.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57462025-02-28T11:20:05.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57472025-02-28T11:20:05.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57482025-02-28T11:20:05.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57492025-02-28T11:20:05.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57502025-02-28T11:20:05.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57512025-02-28T11:20:05.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57522025-02-28T11:20:05.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57532025-02-28T11:20:05.280ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 678.713845ms iteration = 23 status = {}
57542025-02-28T11:20:05.282ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
57552025-02-28T11:20:05.282ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
57562025-02-28T11:20:05.313ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
57572025-02-28T11:20:05.313ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:40376
57582025-02-28T11:20:05.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:40376 req_id = 683d0171-2e3a-4eb1-bc64-3af4d5355ca6 roles = RoleSet { roles: {} } uri = /metrics/producers
57592025-02-28T11:20:05.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:40376 req_id = 683d0171-2e3a-4eb1-bc64-3af4d5355ca6 resource = Database result = Ok(()) uri = /metrics/producers
57602025-02-28T11:20:05.367ZINFOnexus: assigned collector to new producer collector_id = 59e12d21-f0a8-4840-9b1a-87533ec59eae file = nexus/src/app/oximeter.rs:76 producer_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
57612025-02-28T11:20:05.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 53712 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:40376 req_id = 683d0171-2e3a-4eb1-bc64-3af4d5355ca6 response_code = 201 uri = /metrics/producers
57622025-02-28T11:20:05.367ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "683d0171-2e3a-4eb1-bc64-3af4d5355ca6", "content-length": "41", "date": "Fri, 28 Feb 2025 11:20:05 GMT"} })
57632025-02-28T11:20:05.369ZDEBGnexus (producer-registration-task): registered with nexus successfully
57642025-02-28T11:20:05.369ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
57652025-02-28T11:20:05.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c8b90d48-ae17-48e0-8d9f-35c9ec82d91c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57662025-02-28T11:20:05.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c8b90d48-ae17-48e0-8d9f-35c9ec82d91c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57672025-02-28T11:20:05.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2753 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c8b90d48-ae17-48e0-8d9f-35c9ec82d91c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57682025-02-28T11:20:06.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc21152e-48ad-4179-a037-200f1adef61b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57692025-02-28T11:20:06.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc21152e-48ad-4179-a037-200f1adef61b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57702025-02-28T11:20:06.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc21152e-48ad-4179-a037-200f1adef61b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57712025-02-28T11:20:07.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 620 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = ae7eb1c3-59aa-4d29-8d92-83e228fd9b58 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
57722025-02-28T11:20:07.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4001e0a7-b403-490f-b27b-23cc751ea75a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57732025-02-28T11:20:07.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4001e0a7-b403-490f-b27b-23cc751ea75a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57742025-02-28T11:20:07.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4001e0a7-b403-490f-b27b-23cc751ea75a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57752025-02-28T11:20:08.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a13e815f-9489-422e-b5fe-8a0bb509d4ce roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57762025-02-28T11:20:08.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a13e815f-9489-422e-b5fe-8a0bb509d4ce resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57772025-02-28T11:20:08.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a13e815f-9489-422e-b5fe-8a0bb509d4ce response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57782025-02-28T11:20:09.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ca15dc04-c1d5-4edb-85b2-84cf8ef03264 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57792025-02-28T11:20:09.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ca15dc04-c1d5-4edb-85b2-84cf8ef03264 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57802025-02-28T11:20:09.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2901 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ca15dc04-c1d5-4edb-85b2-84cf8ef03264 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57812025-02-28T11:20:10.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 24a303f3-277e-43ac-95e0-455c46dc0623 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57822025-02-28T11:20:10.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 24a303f3-277e-43ac-95e0-455c46dc0623 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57832025-02-28T11:20:10.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 24a303f3-277e-43ac-95e0-455c46dc0623 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57842025-02-28T11:20:11.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f7678a0f-4f8e-4cee-9897-1e5add695ddc roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57852025-02-28T11:20:11.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f7678a0f-4f8e-4cee-9897-1e5add695ddc resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57862025-02-28T11:20:11.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f7678a0f-4f8e-4cee-9897-1e5add695ddc response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57872025-02-28T11:20:12.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 56f6c301-bb65-49a9-90aa-8ea4a0342f01 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57882025-02-28T11:20:12.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 56f6c301-bb65-49a9-90aa-8ea4a0342f01 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57892025-02-28T11:20:12.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2271 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 56f6c301-bb65-49a9-90aa-8ea4a0342f01 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57902025-02-28T11:20:13.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 52159d8c-2677-464c-998d-cd21c52d83c7 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57912025-02-28T11:20:13.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 52159d8c-2677-464c-998d-cd21c52d83c7 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57922025-02-28T11:20:13.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2555 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 52159d8c-2677-464c-998d-cd21c52d83c7 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57932025-02-28T11:20:14.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cbf4ea89-0388-4bc9-91e8-d0b8fe20d3b5 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57942025-02-28T11:20:14.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cbf4ea89-0388-4bc9-91e8-d0b8fe20d3b5 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57952025-02-28T11:20:14.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cbf4ea89-0388-4bc9-91e8-d0b8fe20d3b5 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
57962025-02-28T11:20:14.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
57972025-02-28T11:20:14.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57982025-02-28T11:20:14.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57992025-02-28T11:20:14.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
58002025-02-28T11:20:14.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58012025-02-28T11:20:14.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58022025-02-28T11:20:14.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58032025-02-28T11:20:14.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58042025-02-28T11:20:14.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58052025-02-28T11:20:14.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58062025-02-28T11:20:14.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58072025-02-28T11:20:14.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58082025-02-28T11:20:14.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58092025-02-28T11:20:14.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
58102025-02-28T11:20:14.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58112025-02-28T11:20:14.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58122025-02-28T11:20:14.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
58132025-02-28T11:20:14.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.782658ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
58142025-02-28T11:20:14.629ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58152025-02-28T11:20:14.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58162025-02-28T11:20:14.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.144207ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58172025-02-28T11:20:15.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 54c2a3a5-db69-4d4a-b2d8-4ac4640f71ef roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58182025-02-28T11:20:15.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 54c2a3a5-db69-4d4a-b2d8-4ac4640f71ef resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58192025-02-28T11:20:15.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1970 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 54c2a3a5-db69-4d4a-b2d8-4ac4640f71ef response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58202025-02-28T11:20:16.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c77e9a46-7372-4285-8429-9f3101747625 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58212025-02-28T11:20:16.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c77e9a46-7372-4285-8429-9f3101747625 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58222025-02-28T11:20:16.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c77e9a46-7372-4285-8429-9f3101747625 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58232025-02-28T11:20:17.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 672 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = b21e04b4-a0a3-4a4d-a9d3-d6e81c44df83 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
58242025-02-28T11:20:17.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 32eab674-af62-4480-b034-81580a474955 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58252025-02-28T11:20:17.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 32eab674-af62-4480-b034-81580a474955 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58262025-02-28T11:20:17.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2693 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 32eab674-af62-4480-b034-81580a474955 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58272025-02-28T11:20:18.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0798c4e4-1fba-404a-be31-4364c6306abe roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58282025-02-28T11:20:18.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0798c4e4-1fba-404a-be31-4364c6306abe resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58292025-02-28T11:20:18.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0798c4e4-1fba-404a-be31-4364c6306abe response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58302025-02-28T11:20:19.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d6b7e6fa-1c79-47a3-b150-0046a1a13d3d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58312025-02-28T11:20:19.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d6b7e6fa-1c79-47a3-b150-0046a1a13d3d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58322025-02-28T11:20:19.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2689 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d6b7e6fa-1c79-47a3-b150-0046a1a13d3d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58332025-02-28T11:20:20.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1517f701-4553-40e2-89ed-95511b115b06 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58342025-02-28T11:20:20.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1517f701-4553-40e2-89ed-95511b115b06 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58352025-02-28T11:20:20.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2050 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1517f701-4553-40e2-89ed-95511b115b06 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58362025-02-28T11:20:21.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 869b8478-268d-4eb2-8a2f-719d40f88a9b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58372025-02-28T11:20:21.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 869b8478-268d-4eb2-8a2f-719d40f88a9b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58382025-02-28T11:20:21.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 869b8478-268d-4eb2-8a2f-719d40f88a9b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58392025-02-28T11:20:22.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9cd26122-e3e0-4f05-b9ae-b39454dfd8e8 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58402025-02-28T11:20:22.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9cd26122-e3e0-4f05-b9ae-b39454dfd8e8 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58412025-02-28T11:20:22.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2597 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9cd26122-e3e0-4f05-b9ae-b39454dfd8e8 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58422025-02-28T11:20:23.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e8b3e0fe-87b6-4577-8853-8aed6e0c1103 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58432025-02-28T11:20:23.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e8b3e0fe-87b6-4577-8853-8aed6e0c1103 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58442025-02-28T11:20:23.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1925 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e8b3e0fe-87b6-4577-8853-8aed6e0c1103 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58452025-02-28T11:20:24.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
58462025-02-28T11:20:24.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58472025-02-28T11:20:24.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58482025-02-28T11:20:24.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
58492025-02-28T11:20:24.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58502025-02-28T11:20:24.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58512025-02-28T11:20:24.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58522025-02-28T11:20:24.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58532025-02-28T11:20:24.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58542025-02-28T11:20:24.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58552025-02-28T11:20:24.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58562025-02-28T11:20:24.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58572025-02-28T11:20:24.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.66767ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58582025-02-28T11:20:24.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58592025-02-28T11:20:24.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58602025-02-28T11:20:24.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58612025-02-28T11:20:24.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
58622025-02-28T11:20:24.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58632025-02-28T11:20:24.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58642025-02-28T11:20:24.651ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
58652025-02-28T11:20:24.651ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.649585ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
58662025-02-28T11:20:24.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8b61ccac-14c8-4d02-b33d-c2761bd4a89a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58672025-02-28T11:20:24.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8b61ccac-14c8-4d02-b33d-c2761bd4a89a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58682025-02-28T11:20:24.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1885 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8b61ccac-14c8-4d02-b33d-c2761bd4a89a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58692025-02-28T11:20:25.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2b8d5e6e-18bf-4ee3-b665-7502d329cb95 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58702025-02-28T11:20:25.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2b8d5e6e-18bf-4ee3-b665-7502d329cb95 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58712025-02-28T11:20:25.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2211 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2b8d5e6e-18bf-4ee3-b665-7502d329cb95 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58722025-02-28T11:20:26.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 545332a1-452e-4070-9f55-3bbb07489c77 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58732025-02-28T11:20:26.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 545332a1-452e-4070-9f55-3bbb07489c77 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58742025-02-28T11:20:26.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2522 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 545332a1-452e-4070-9f55-3bbb07489c77 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58752025-02-28T11:20:27.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 549 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 42d39387-37da-4b02-91b6-19a2073e2970 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
58762025-02-28T11:20:27.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6bbbd01b-7b9b-4027-a283-6a2c84ec7cd5 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58772025-02-28T11:20:27.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6bbbd01b-7b9b-4027-a283-6a2c84ec7cd5 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58782025-02-28T11:20:27.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6bbbd01b-7b9b-4027-a283-6a2c84ec7cd5 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58792025-02-28T11:20:28.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0411a11a-b68a-4a32-b594-d04b8f17bb78 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58802025-02-28T11:20:28.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0411a11a-b68a-4a32-b594-d04b8f17bb78 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58812025-02-28T11:20:28.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0411a11a-b68a-4a32-b594-d04b8f17bb78 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58822025-02-28T11:20:29.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d4f5049-6294-450c-8e93-1f3518d10e3e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58832025-02-28T11:20:29.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d4f5049-6294-450c-8e93-1f3518d10e3e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58842025-02-28T11:20:29.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9d4f5049-6294-450c-8e93-1f3518d10e3e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58852025-02-28T11:20:30.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = af75c40a-1aea-4ed9-aae4-12023226f0a1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58862025-02-28T11:20:30.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = af75c40a-1aea-4ed9-aae4-12023226f0a1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58872025-02-28T11:20:30.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2663 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = af75c40a-1aea-4ed9-aae4-12023226f0a1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58882025-02-28T11:20:31.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ea7c57fd-0894-4ec4-b7b3-f1b3bc3fcc23 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58892025-02-28T11:20:31.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ea7c57fd-0894-4ec4-b7b3-f1b3bc3fcc23 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58902025-02-28T11:20:31.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2584 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ea7c57fd-0894-4ec4-b7b3-f1b3bc3fcc23 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58912025-02-28T11:20:32.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 18ffe0ba-8512-4c21-8e94-3cf8d8d40263 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
58922025-02-28T11:20:32.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 18ffe0ba-8512-4c21-8e94-3cf8d8d40263 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
58932025-02-28T11:20:32.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3509 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = 18ffe0ba-8512-4c21-8e94-3cf8d8d40263 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
58942025-02-28T11:20:32.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = fbb3de6e-60ad-410a-9abc-d5a01b727d28 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
58952025-02-28T11:20:32.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = fbb3de6e-60ad-410a-9abc-d5a01b727d28 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
58962025-02-28T11:20:32.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2356 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62240 req_id = fbb3de6e-60ad-410a-9abc-d5a01b727d28 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
58972025-02-28T11:20:32.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dffc99bf-fef3-406e-b6a7-778bb6fc7777 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58982025-02-28T11:20:32.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dffc99bf-fef3-406e-b6a7-778bb6fc7777 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
58992025-02-28T11:20:32.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dffc99bf-fef3-406e-b6a7-778bb6fc7777 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
59002025-02-28T11:20:33.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 60d4572d-c6d6-4971-b631-1b106ebc0f4a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
59012025-02-28T11:20:33.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 60d4572d-c6d6-4971-b631-1b106ebc0f4a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
59022025-02-28T11:20:33.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 60d4572d-c6d6-4971-b631-1b106ebc0f4a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
59032025-02-28T11:20:34.595ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
59042025-02-28T11:20:34.595ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
59052025-02-28T11:20:34.595ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59062025-02-28T11:20:34.595ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59072025-02-28T11:20:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59082025-02-28T11:20:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59092025-02-28T11:20:34.597ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
59102025-02-28T11:20:34.598ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1803, tv_nsec: 147737392 } })
59112025-02-28T11:20:34.598ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1803, tv_nsec: 147799144 } })
59122025-02-28T11:20:34.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
59132025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.653548ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
59142025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
59152025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
59162025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
59172025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59182025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59192025-02-28T11:20:34.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59202025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59212025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
59222025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59232025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
59242025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
59252025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
59262025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
59272025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
59282025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
59292025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59302025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59312025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
59322025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
59332025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
59342025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59352025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
59362025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
59372025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59382025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
59392025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
59402025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59412025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59422025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
59432025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59442025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
59452025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59462025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
59472025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59482025-02-28T11:20:34.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
59492025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59502025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59512025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59522025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59532025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59542025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
59552025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
59562025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59572025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59582025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59592025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59602025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59612025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59622025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
59632025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59642025-02-28T11:20:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59652025-02-28T11:20:34.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59662025-02-28T11:20:34.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59672025-02-28T11:20:34.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59682025-02-28T11:20:34.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59692025-02-28T11:20:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59702025-02-28T11:20:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
59712025-02-28T11:20:34.606ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59722025-02-28T11:20:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59732025-02-28T11:20:34.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59742025-02-28T11:20:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59752025-02-28T11:20:34.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59762025-02-28T11:20:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59772025-02-28T11:20:34.647ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59782025-02-28T11:20:34.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59792025-02-28T11:20:34.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59802025-02-28T11:20:34.648ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 46.802353ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
59812025-02-28T11:20:34.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59822025-02-28T11:20:34.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59832025-02-28T11:20:34.650ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59842025-02-28T11:20:34.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59852025-02-28T11:20:34.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59862025-02-28T11:20:34.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59872025-02-28T11:20:34.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59882025-02-28T11:20:34.654ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59892025-02-28T11:20:34.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59902025-02-28T11:20:34.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59912025-02-28T11:20:34.654ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59922025-02-28T11:20:34.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59932025-02-28T11:20:34.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59942025-02-28T11:20:34.655ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59952025-02-28T11:20:34.655ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59962025-02-28T11:20:34.655ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59972025-02-28T11:20:34.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59982025-02-28T11:20:34.656ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1803, tv_nsec: 206049381 } })
59992025-02-28T11:20:34.656ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60002025-02-28T11:20:34.656ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
60012025-02-28T11:20:34.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60022025-02-28T11:20:34.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60032025-02-28T11:20:34.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60042025-02-28T11:20:34.657ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60052025-02-28T11:20:34.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.224684ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
60062025-02-28T11:20:34.658ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60072025-02-28T11:20:34.658ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60082025-02-28T11:20:34.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60092025-02-28T11:20:34.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60102025-02-28T11:20:34.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60112025-02-28T11:20:34.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.357168ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
60122025-02-28T11:20:34.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60132025-02-28T11:20:34.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60142025-02-28T11:20:34.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60152025-02-28T11:20:34.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60162025-02-28T11:20:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60172025-02-28T11:20:34.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60182025-02-28T11:20:34.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60192025-02-28T11:20:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60202025-02-28T11:20:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
60212025-02-28T11:20:34.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60222025-02-28T11:20:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60232025-02-28T11:20:34.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60242025-02-28T11:20:34.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60252025-02-28T11:20:34.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60262025-02-28T11:20:34.667ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60272025-02-28T11:20:34.667ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
60282025-02-28T11:20:34.667ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60292025-02-28T11:20:34.669ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf89f582-50ee-495a-a1d9-25562ae620f8", "content-length": "26", "date": "Fri, 28 Feb 2025 11:20:34 GMT"} })
60302025-02-28T11:20:34.669ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60312025-02-28T11:20:34.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
60322025-02-28T11:20:34.670ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60332025-02-28T11:20:34.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60342025-02-28T11:20:34.671ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60352025-02-28T11:20:34.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60362025-02-28T11:20:34.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60372025-02-28T11:20:34.672ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
60382025-02-28T11:20:34.672ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 71.266156ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
60392025-02-28T11:20:34.674ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60402025-02-28T11:20:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60412025-02-28T11:20:34.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60422025-02-28T11:20:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60432025-02-28T11:20:34.678ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
60442025-02-28T11:20:34.678ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.410548ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
60452025-02-28T11:20:34.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60462025-02-28T11:20:34.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60472025-02-28T11:20:34.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60482025-02-28T11:20:34.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60492025-02-28T11:20:34.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60502025-02-28T11:20:34.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
60512025-02-28T11:20:34.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60522025-02-28T11:20:34.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60532025-02-28T11:20:34.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.145738ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60542025-02-28T11:20:34.690ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.901934ms iteration = 24 status = 0
60552025-02-28T11:20:34.691ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.895206ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60562025-02-28T11:20:34.698ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60572025-02-28T11:20:34.698ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60582025-02-28T11:20:34.698ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60592025-02-28T11:20:34.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60602025-02-28T11:20:34.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.949117ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60612025-02-28T11:20:34.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.249226ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
60622025-02-28T11:20:34.718ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60632025-02-28T11:20:34.718ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 116.997936ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60642025-02-28T11:20:34.729ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.132204ms iteration = 27 status = {"physical_disks_added":0}
60652025-02-28T11:20:34.739ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60662025-02-28T11:20:34.739ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60672025-02-28T11:20:34.739ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.760571ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60682025-02-28T11:20:34.739ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60692025-02-28T11:20:34.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60702025-02-28T11:20:34.756ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60712025-02-28T11:20:34.756ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9226519-7d52-40a2-9f93-78717a1f20ae", "content-length": "2", "date": "Fri, 28 Feb 2025 11:20:34 GMT"} })
60722025-02-28T11:20:34.757ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60732025-02-28T11:20:34.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60742025-02-28T11:20:34.759ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 164.121125ms iteration = 24 status = null
60752025-02-28T11:20:34.767ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
60762025-02-28T11:20:34.767ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60772025-02-28T11:20:34.767ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f72626a9-4688-42b2-a532-7549851e4e3c", "content-length": "26", "date": "Fri, 28 Feb 2025 11:20:34 GMT"} })
60782025-02-28T11:20:34.767ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60792025-02-28T11:20:34.769ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60802025-02-28T11:20:34.777ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
60812025-02-28T11:20:34.777ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60822025-02-28T11:20:34.777ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdcfc0d0-4bf7-4446-a614-161932af5ea6", "content-length": "26", "date": "Fri, 28 Feb 2025 11:20:34 GMT"} })
60832025-02-28T11:20:34.777ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60842025-02-28T11:20:34.779ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
60852025-02-28T11:20:34.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60862025-02-28T11:20:34.806ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60872025-02-28T11:20:34.806ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60882025-02-28T11:20:34.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60892025-02-28T11:20:34.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60902025-02-28T11:20:34.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60912025-02-28T11:20:34.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60922025-02-28T11:20:34.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60932025-02-28T11:20:34.812ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60942025-02-28T11:20:34.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60952025-02-28T11:20:34.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60962025-02-28T11:20:34.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60972025-02-28T11:20:34.841ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 245.374635ms iteration = 24 status = {}
60982025-02-28T11:20:34.873ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa6be08f-f381-4123-8a89-821aef33f5de", "content-length": "372", "date": "Fri, 28 Feb 2025 11:20:34 GMT"} })
60992025-02-28T11:20:34.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61002025-02-28T11:20:34.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61012025-02-28T11:20:34.884ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61022025-02-28T11:20:34.885ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "206b3431-e0d7-4100-8791-db99182e5cfd", "content-length": "691", "date": "Fri, 28 Feb 2025 11:20:33 GMT"} })
61032025-02-28T11:20:34.885ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
61042025-02-28T11:20:34.885ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
61052025-02-28T11:20:34.885ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
61062025-02-28T11:20:34.887ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 285.607547ms iteration = 25 status = {}
61072025-02-28T11:20:34.917ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
61082025-02-28T11:20:34.917ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61092025-02-28T11:20:34.917ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7ce8914f-dacb-469a-aee3-56a0bbf4a05a", "date": "Fri, 28 Feb 2025 11:20:33 GMT"} })
61102025-02-28T11:20:34.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61112025-02-28T11:20:34.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61122025-02-28T11:20:34.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61132025-02-28T11:20:34.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61142025-02-28T11:20:34.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61152025-02-28T11:20:34.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61162025-02-28T11:20:34.927ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
61172025-02-28T11:20:34.927ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61182025-02-28T11:20:34.927ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0206be8f-8af4-4d7c-9058-581ef27d0281", "date": "Fri, 28 Feb 2025 11:20:33 GMT"} })
61192025-02-28T11:20:34.929ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 328.530396ms iteration = 25 status = {}
61202025-02-28T11:20:34.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61212025-02-28T11:20:34.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61222025-02-28T11:20:34.936ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
61232025-02-28T11:20:34.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61242025-02-28T11:20:34.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61252025-02-28T11:20:34.946ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
61262025-02-28T11:20:34.946ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8da3215-55eb-4489-bfe2-3338ba14c0d7", "content-length": "134", "date": "Fri, 28 Feb 2025 11:20:34 GMT"} })
61272025-02-28T11:20:34.946ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
61282025-02-28T11:20:34.947ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
61292025-02-28T11:20:34.947ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
61302025-02-28T11:20:34.947ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61312025-02-28T11:20:34.947ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61322025-02-28T11:20:34.947ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61332025-02-28T11:20:34.947ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61342025-02-28T11:20:34.947ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61352025-02-28T11:20:34.947ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61362025-02-28T11:20:34.947ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61372025-02-28T11:20:34.947ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
61382025-02-28T11:20:34.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61392025-02-28T11:20:34.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61402025-02-28T11:20:34.949ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
61412025-02-28T11:20:34.950ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c058072-69fd-4e3f-a59a-a9317169859c", "content-length": "2", "date": "Fri, 28 Feb 2025 11:20:34 GMT"} })
61422025-02-28T11:20:34.950ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61432025-02-28T11:20:34.950ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5abb80d8-7cba-4f5b-9feb-5057179ed29b", "content-length": "52", "date": "Fri, 28 Feb 2025 11:20:34 GMT"} })
61442025-02-28T11:20:34.950ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
61452025-02-28T11:20:34.950ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61462025-02-28T11:20:35.046ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9f59defc-3be3-4a34-91ff-fc4de292ca05", "date": "Fri, 28 Feb 2025 11:20:35 GMT"} })
61472025-02-28T11:20:35.046ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
61482025-02-28T11:20:35.046ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61492025-02-28T11:20:35.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4f495509-69fc-41ea-918a-143d28f412ca roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61502025-02-28T11:20:35.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4f495509-69fc-41ea-918a-143d28f412ca resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61512025-02-28T11:20:35.047ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "555ccf59-78ba-434e-9e33-b290bcb18139", "content-length": "682", "date": "Fri, 28 Feb 2025 11:20:35 GMT"} })
61522025-02-28T11:20:35.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61532025-02-28T11:20:35.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61542025-02-28T11:20:35.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4f495509-69fc-41ea-918a-143d28f412ca response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61552025-02-28T11:20:35.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61562025-02-28T11:20:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61572025-02-28T11:20:35.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61582025-02-28T11:20:35.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61592025-02-28T11:20:35.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61602025-02-28T11:20:35.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61612025-02-28T11:20:35.064ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 463.039246ms iteration = 24 status = {}
61622025-02-28T11:20:36.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e3861f59-26ef-43a2-9319-43060082aed8 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61632025-02-28T11:20:36.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e3861f59-26ef-43a2-9319-43060082aed8 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61642025-02-28T11:20:36.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1792 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e3861f59-26ef-43a2-9319-43060082aed8 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61652025-02-28T11:20:37.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 685 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = cb5ab24d-5718-4566-a938-ec4cf3a4add0 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
61662025-02-28T11:20:37.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = aa9b2819-8d25-4559-a0d1-8546588d16f9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61672025-02-28T11:20:37.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = aa9b2819-8d25-4559-a0d1-8546588d16f9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61682025-02-28T11:20:37.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = aa9b2819-8d25-4559-a0d1-8546588d16f9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61692025-02-28T11:20:38.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 98a90783-cb58-469b-8103-a61505a8b328 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61702025-02-28T11:20:38.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 98a90783-cb58-469b-8103-a61505a8b328 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61712025-02-28T11:20:38.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 98a90783-cb58-469b-8103-a61505a8b328 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61722025-02-28T11:20:39.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b60f6fba-673a-451e-84bd-b826d3f980d2 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61732025-02-28T11:20:39.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b60f6fba-673a-451e-84bd-b826d3f980d2 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61742025-02-28T11:20:39.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b60f6fba-673a-451e-84bd-b826d3f980d2 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61752025-02-28T11:20:40.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9fd6db2f-4ba5-43f1-9888-f6235816529c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61762025-02-28T11:20:40.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9fd6db2f-4ba5-43f1-9888-f6235816529c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61772025-02-28T11:20:40.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2420 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 9fd6db2f-4ba5-43f1-9888-f6235816529c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61782025-02-28T11:20:41.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ef6d5a18-8f02-456a-90f3-acbf2973efb6 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61792025-02-28T11:20:41.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ef6d5a18-8f02-456a-90f3-acbf2973efb6 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61802025-02-28T11:20:41.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1953 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ef6d5a18-8f02-456a-90f3-acbf2973efb6 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61812025-02-28T11:20:42.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e0babcf-d2fc-4eb4-b2c0-a05ebc89ec9e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61822025-02-28T11:20:42.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e0babcf-d2fc-4eb4-b2c0-a05ebc89ec9e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61832025-02-28T11:20:42.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e0babcf-d2fc-4eb4-b2c0-a05ebc89ec9e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61842025-02-28T11:20:43.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4282772a-e1ed-46f1-8ad4-18529120a0f1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61852025-02-28T11:20:43.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4282772a-e1ed-46f1-8ad4-18529120a0f1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61862025-02-28T11:20:43.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4282772a-e1ed-46f1-8ad4-18529120a0f1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61872025-02-28T11:20:44.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 997d1990-1f3b-4220-a81d-c71f516072e1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61882025-02-28T11:20:44.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 997d1990-1f3b-4220-a81d-c71f516072e1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61892025-02-28T11:20:44.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2409 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 997d1990-1f3b-4220-a81d-c71f516072e1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
61902025-02-28T11:20:44.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
61912025-02-28T11:20:44.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61922025-02-28T11:20:44.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61932025-02-28T11:20:44.600ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
61942025-02-28T11:20:44.600ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61952025-02-28T11:20:44.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61962025-02-28T11:20:44.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61972025-02-28T11:20:44.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61982025-02-28T11:20:44.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61992025-02-28T11:20:44.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62002025-02-28T11:20:44.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62012025-02-28T11:20:44.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.000985ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62022025-02-28T11:20:44.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62032025-02-28T11:20:44.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62042025-02-28T11:20:44.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62052025-02-28T11:20:44.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62062025-02-28T11:20:44.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
62072025-02-28T11:20:44.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62082025-02-28T11:20:44.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62092025-02-28T11:20:44.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
62102025-02-28T11:20:44.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.223552ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
62112025-02-28T11:20:45.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e208aa5f-896d-42cf-a5eb-332549559a4f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62122025-02-28T11:20:45.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e208aa5f-896d-42cf-a5eb-332549559a4f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62132025-02-28T11:20:45.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e208aa5f-896d-42cf-a5eb-332549559a4f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62142025-02-28T11:20:46.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f3412271-a2d6-41ac-8b7b-0d168d6ba86e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62152025-02-28T11:20:46.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f3412271-a2d6-41ac-8b7b-0d168d6ba86e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62162025-02-28T11:20:46.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f3412271-a2d6-41ac-8b7b-0d168d6ba86e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62172025-02-28T11:20:47.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1034 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 5af165e0-9e99-4899-bae6-288919431d95 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
62182025-02-28T11:20:47.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cc312320-3bd2-4003-9ee2-d01ad67910ba roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62192025-02-28T11:20:47.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cc312320-3bd2-4003-9ee2-d01ad67910ba resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62202025-02-28T11:20:47.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cc312320-3bd2-4003-9ee2-d01ad67910ba response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62212025-02-28T11:20:48.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c2b8fd57-53af-42a9-9d2b-8ff3947f6356 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62222025-02-28T11:20:48.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c2b8fd57-53af-42a9-9d2b-8ff3947f6356 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62232025-02-28T11:20:48.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2838 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c2b8fd57-53af-42a9-9d2b-8ff3947f6356 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62242025-02-28T11:20:49.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 58ff1449-0de1-4661-85e7-37a28d8c2f2f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62252025-02-28T11:20:49.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 58ff1449-0de1-4661-85e7-37a28d8c2f2f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62262025-02-28T11:20:49.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 58ff1449-0de1-4661-85e7-37a28d8c2f2f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62272025-02-28T11:20:50.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = beb0f20f-1168-45cc-8d62-f85664256b37 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62282025-02-28T11:20:50.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = beb0f20f-1168-45cc-8d62-f85664256b37 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62292025-02-28T11:20:50.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = beb0f20f-1168-45cc-8d62-f85664256b37 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62302025-02-28T11:20:51.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1bccb190-84cf-424e-a6d3-d155304f89d1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62312025-02-28T11:20:51.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1bccb190-84cf-424e-a6d3-d155304f89d1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62322025-02-28T11:20:51.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1bccb190-84cf-424e-a6d3-d155304f89d1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62332025-02-28T11:20:52.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ea4a63dd-e6b2-4252-9425-2df91223761b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62342025-02-28T11:20:52.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ea4a63dd-e6b2-4252-9425-2df91223761b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62352025-02-28T11:20:52.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ea4a63dd-e6b2-4252-9425-2df91223761b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62362025-02-28T11:20:53.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a52ef7c0-dc2a-45f4-9a1c-79c194b07c95 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62372025-02-28T11:20:53.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a52ef7c0-dc2a-45f4-9a1c-79c194b07c95 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62382025-02-28T11:20:53.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a52ef7c0-dc2a-45f4-9a1c-79c194b07c95 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62392025-02-28T11:20:54.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2fe5c08d-15f2-4d90-8088-474d798089f5 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62402025-02-28T11:20:54.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2fe5c08d-15f2-4d90-8088-474d798089f5 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62412025-02-28T11:20:54.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2fe5c08d-15f2-4d90-8088-474d798089f5 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62422025-02-28T11:20:54.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
62432025-02-28T11:20:54.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62442025-02-28T11:20:54.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62452025-02-28T11:20:54.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
62462025-02-28T11:20:54.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62472025-02-28T11:20:54.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62482025-02-28T11:20:54.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62492025-02-28T11:20:54.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62502025-02-28T11:20:54.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62512025-02-28T11:20:54.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62522025-02-28T11:20:54.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62532025-02-28T11:20:54.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62542025-02-28T11:20:54.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62552025-02-28T11:20:54.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62562025-02-28T11:20:54.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62572025-02-28T11:20:54.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
62582025-02-28T11:20:54.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62592025-02-28T11:20:54.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62602025-02-28T11:20:54.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
62612025-02-28T11:20:54.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.380671ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
62622025-02-28T11:20:54.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.010144ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62632025-02-28T11:20:55.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dadb8369-5e66-460c-ba0e-bde86c6d58bb roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62642025-02-28T11:20:55.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dadb8369-5e66-460c-ba0e-bde86c6d58bb resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62652025-02-28T11:20:55.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = dadb8369-5e66-460c-ba0e-bde86c6d58bb response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62662025-02-28T11:20:56.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cb45d4c4-0274-4713-bbd6-5ffaacfb450b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62672025-02-28T11:20:56.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cb45d4c4-0274-4713-bbd6-5ffaacfb450b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62682025-02-28T11:20:56.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2904 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cb45d4c4-0274-4713-bbd6-5ffaacfb450b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62692025-02-28T11:20:57.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 673 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 33855da4-126a-42c1-b6e3-e63de91f9d28 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
62702025-02-28T11:20:57.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc3aee21-f604-4382-8f94-3dbd70afe444 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62712025-02-28T11:20:57.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc3aee21-f604-4382-8f94-3dbd70afe444 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62722025-02-28T11:20:57.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = bc3aee21-f604-4382-8f94-3dbd70afe444 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62732025-02-28T11:20:58.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 05f059dc-1e08-42fa-89d9-c6476d4db5f2 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62742025-02-28T11:20:58.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 05f059dc-1e08-42fa-89d9-c6476d4db5f2 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62752025-02-28T11:20:58.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2871 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 05f059dc-1e08-42fa-89d9-c6476d4db5f2 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62762025-02-28T11:20:59.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 155b951a-8a2c-4c9f-82f4-51523aa40f46 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62772025-02-28T11:20:59.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 155b951a-8a2c-4c9f-82f4-51523aa40f46 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62782025-02-28T11:20:59.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 155b951a-8a2c-4c9f-82f4-51523aa40f46 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62792025-02-28T11:21:00.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fc125e6e-fe6f-44cb-b6ca-a07a50176667 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62802025-02-28T11:21:00.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fc125e6e-fe6f-44cb-b6ca-a07a50176667 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62812025-02-28T11:21:00.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2595 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fc125e6e-fe6f-44cb-b6ca-a07a50176667 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62822025-02-28T11:21:01.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f52a54ce-9371-4e7c-a907-75c74756947e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62832025-02-28T11:21:01.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f52a54ce-9371-4e7c-a907-75c74756947e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62842025-02-28T11:21:01.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f52a54ce-9371-4e7c-a907-75c74756947e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62852025-02-28T11:21:02.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d76ed32d-55d6-485e-829b-3336ee23d04e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62862025-02-28T11:21:02.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d76ed32d-55d6-485e-829b-3336ee23d04e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62872025-02-28T11:21:02.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d76ed32d-55d6-485e-829b-3336ee23d04e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62882025-02-28T11:21:03.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b97681ed-3a58-4537-8dcc-d4d1f5069558 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62892025-02-28T11:21:03.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b97681ed-3a58-4537-8dcc-d4d1f5069558 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62902025-02-28T11:21:03.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2548 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b97681ed-3a58-4537-8dcc-d4d1f5069558 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
62912025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
62922025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
62932025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62942025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
62952025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62962025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
62972025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
62982025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
62992025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
63002025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
63012025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
63022025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
63032025-02-28T11:21:04.595ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-28 11:11:04.595761157 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
63042025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
63052025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
63062025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
63072025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
63082025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63092025-02-28T11:21:04.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63102025-02-28T11:21:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63112025-02-28T11:21:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63122025-02-28T11:21:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63132025-02-28T11:21:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
63142025-02-28T11:21:04.596ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cd949b0-a160-497e-a9d3-708f380c3425.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 145538723 } })
63152025-02-28T11:21:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
63162025-02-28T11:21:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63172025-02-28T11:21:04.596ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c58b6d59-7cb2-478f-9d27-4e70c13f0853.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("daf1508c-21c6-4c2b-91a0-3e717092a118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 145671746 } })
63182025-02-28T11:21:04.596ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
63192025-02-28T11:21:04.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 997.091\u{b5}s iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
63202025-02-28T11:21:04.596ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
63212025-02-28T11:21:04.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.194016ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
63222025-02-28T11:21:04.597ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
63232025-02-28T11:21:04.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63242025-02-28T11:21:04.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63252025-02-28T11:21:04.598ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 147328631 } })
63262025-02-28T11:21:04.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
63272025-02-28T11:21:04.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63282025-02-28T11:21:04.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63292025-02-28T11:21:04.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 148992027 } })
63302025-02-28T11:21:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63312025-02-28T11:21:04.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
63322025-02-28T11:21:04.600ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-28 11:11:04.595761157 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
63332025-02-28T11:21:04.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
63342025-02-28T11:21:04.600ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.608178ms iteration = 13 status = {"expiration":"2025-02-28T11:11:04.595761157Z","pruned":[]}
63352025-02-28T11:21:04.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63362025-02-28T11:21:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63372025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63382025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63392025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63402025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
63412025-02-28T11:21:04.601ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 7549b177-a582-4102-91fb-b7e6324fd615
63422025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.02\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"7549b177-a582-4102-91fb-b7e6324fd615"}
63432025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
63442025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
63452025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63462025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
63472025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63482025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
63492025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
63502025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
63512025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
63522025-02-28T11:21:04.601ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
63532025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63542025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
63552025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
63562025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
63572025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63582025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
63592025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
63602025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63612025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63622025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
63632025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
63642025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63652025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63662025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
63672025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
63682025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
63692025-02-28T11:21:04.601ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
63702025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
63712025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63722025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
63732025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
63742025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63752025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
63762025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63772025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
63782025-02-28T11:21:04.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63792025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
63802025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
63812025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63822025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63832025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
63842025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
63852025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
63862025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63872025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63882025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
63892025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
63902025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63912025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63922025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63932025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63942025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63952025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63962025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63972025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63982025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63992025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64002025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
64012025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64022025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64032025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64042025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64052025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64062025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64072025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64082025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64092025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64102025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64112025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64122025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64132025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.654232ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64142025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64152025-02-28T11:21:04.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64162025-02-28T11:21:04.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64172025-02-28T11:21:04.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64182025-02-28T11:21:04.604ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.171039ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
64192025-02-28T11:21:04.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64202025-02-28T11:21:04.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64212025-02-28T11:21:04.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64222025-02-28T11:21:04.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64232025-02-28T11:21:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64242025-02-28T11:21:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64252025-02-28T11:21:04.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64262025-02-28T11:21:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64272025-02-28T11:21:04.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64282025-02-28T11:21:04.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64292025-02-28T11:21:04.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64302025-02-28T11:21:04.610ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64312025-02-28T11:21:04.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64322025-02-28T11:21:04.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64332025-02-28T11:21:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
64342025-02-28T11:21:04.612ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
64352025-02-28T11:21:04.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
64362025-02-28T11:21:04.613ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64372025-02-28T11:21:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
64382025-02-28T11:21:04.613ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
64392025-02-28T11:21:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64402025-02-28T11:21:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
64412025-02-28T11:21:04.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64422025-02-28T11:21:04.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64432025-02-28T11:21:04.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64442025-02-28T11:21:04.615ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64452025-02-28T11:21:04.616ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64462025-02-28T11:21:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64472025-02-28T11:21:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64482025-02-28T11:21:04.617ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64492025-02-28T11:21:04.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64502025-02-28T11:21:04.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64512025-02-28T11:21:04.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.492795ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
64522025-02-28T11:21:04.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64532025-02-28T11:21:04.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64542025-02-28T11:21:04.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64552025-02-28T11:21:04.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64562025-02-28T11:21:04.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64572025-02-28T11:21:04.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64582025-02-28T11:21:04.625ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64592025-02-28T11:21:04.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64602025-02-28T11:21:04.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64612025-02-28T11:21:04.626ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64622025-02-28T11:21:04.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64632025-02-28T11:21:04.626ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64642025-02-28T11:21:04.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
64652025-02-28T11:21:04.629ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64662025-02-28T11:21:04.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
64672025-02-28T11:21:04.631ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64682025-02-28T11:21:04.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64692025-02-28T11:21:04.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64702025-02-28T11:21:04.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64712025-02-28T11:21:04.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64722025-02-28T11:21:04.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
64732025-02-28T11:21:04.634ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64742025-02-28T11:21:04.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64752025-02-28T11:21:04.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 34.53637ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64762025-02-28T11:21:04.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64772025-02-28T11:21:04.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.826038ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64782025-02-28T11:21:04.638ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1833, tv_nsec: 188013693 } })
64792025-02-28T11:21:04.638ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
64802025-02-28T11:21:04.638ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
64812025-02-28T11:21:04.638ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
64822025-02-28T11:21:04.638ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64832025-02-28T11:21:04.639ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
64842025-02-28T11:21:04.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64852025-02-28T11:21:04.640ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64862025-02-28T11:21:04.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64872025-02-28T11:21:04.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64882025-02-28T11:21:04.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64892025-02-28T11:21:04.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64902025-02-28T11:21:04.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.337747ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
64912025-02-28T11:21:04.645ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64922025-02-28T11:21:04.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64932025-02-28T11:21:04.646ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64942025-02-28T11:21:04.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64952025-02-28T11:21:04.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64962025-02-28T11:21:04.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64972025-02-28T11:21:04.647ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
64982025-02-28T11:21:04.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
64992025-02-28T11:21:04.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65002025-02-28T11:21:04.647ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 45.217598ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65012025-02-28T11:21:04.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65022025-02-28T11:21:04.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65032025-02-28T11:21:04.649ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65042025-02-28T11:21:04.650ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65052025-02-28T11:21:04.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65062025-02-28T11:21:04.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65072025-02-28T11:21:04.650ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65082025-02-28T11:21:04.650ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65092025-02-28T11:21:04.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65102025-02-28T11:21:04.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 50.89009ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
65112025-02-28T11:21:04.652ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
65122025-02-28T11:21:04.652ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
65132025-02-28T11:21:04.652ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
65142025-02-28T11:21:04.652ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65152025-02-28T11:21:04.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65162025-02-28T11:21:04.654ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65172025-02-28T11:21:04.654ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65182025-02-28T11:21:04.654ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65192025-02-28T11:21:04.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65202025-02-28T11:21:04.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65212025-02-28T11:21:04.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65222025-02-28T11:21:04.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65232025-02-28T11:21:04.656ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65242025-02-28T11:21:04.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65252025-02-28T11:21:04.658ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
65262025-02-28T11:21:04.658ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
65272025-02-28T11:21:04.658ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.354857ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
65282025-02-28T11:21:04.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65292025-02-28T11:21:04.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65302025-02-28T11:21:04.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65312025-02-28T11:21:04.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 15b6203e-1bed-47db-afaf-76e85dc249c4 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
65322025-02-28T11:21:04.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 15b6203e-1bed-47db-afaf-76e85dc249c4 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
65332025-02-28T11:21:04.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65342025-02-28T11:21:04.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65352025-02-28T11:21:04.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65362025-02-28T11:21:04.671ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65372025-02-28T11:21:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
65382025-02-28T11:21:04.674ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65392025-02-28T11:21:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65402025-02-28T11:21:04.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5828 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 15b6203e-1bed-47db-afaf-76e85dc249c4 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
65412025-02-28T11:21:04.677ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 75.66758ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
65422025-02-28T11:21:04.678ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65432025-02-28T11:21:04.681ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
65442025-02-28T11:21:04.681ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.027145ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
65452025-02-28T11:21:04.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
65462025-02-28T11:21:04.681ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65472025-02-28T11:21:04.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65482025-02-28T11:21:04.683ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 81.634089ms iteration = 6 status = {"nsuccess":5}
65492025-02-28T11:21:04.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65502025-02-28T11:21:04.693ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
65512025-02-28T11:21:04.693ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
65522025-02-28T11:21:04.693ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 91.480219ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
65532025-02-28T11:21:04.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65542025-02-28T11:21:04.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65552025-02-28T11:21:04.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65562025-02-28T11:21:04.695ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65572025-02-28T11:21:04.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65582025-02-28T11:21:04.697ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65592025-02-28T11:21:04.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
65602025-02-28T11:21:04.699ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65612025-02-28T11:21:04.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65622025-02-28T11:21:04.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65632025-02-28T11:21:04.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65642025-02-28T11:21:04.707ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65652025-02-28T11:21:04.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65662025-02-28T11:21:04.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65672025-02-28T11:21:04.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
65682025-02-28T11:21:04.711ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 110.019636ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65692025-02-28T11:21:04.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65702025-02-28T11:21:04.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
65712025-02-28T11:21:04.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65722025-02-28T11:21:04.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65732025-02-28T11:21:04.713ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
65742025-02-28T11:21:04.713ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 0 version = 2
65752025-02-28T11:21:04.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65762025-02-28T11:21:04.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65772025-02-28T11:21:04.714ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65782025-02-28T11:21:04.714ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65792025-02-28T11:21:04.714ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65802025-02-28T11:21:04.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65812025-02-28T11:21:04.715ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-28T11:09:02.015184Z, time_modified: 2025-02-28T11:09:02.015184Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }) }
65822025-02-28T11:21:04.715ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 120.010741ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]}},"default_endpoint":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
65832025-02-28T11:21:04.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65842025-02-28T11:21:04.718ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.966585ms iteration = 25 status = 0
65852025-02-28T11:21:04.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65862025-02-28T11:21:04.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65872025-02-28T11:21:04.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65882025-02-28T11:21:04.723ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 1 version = 2
65892025-02-28T11:21:04.723ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
65902025-02-28T11:21:04.723ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-28 11:09:19.025515 UTC dns_group = external generation = 2
65912025-02-28T11:21:04.723ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 127.768456ms iteration = 13 status = {"generation":2}
65922025-02-28T11:21:04.732ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
65932025-02-28T11:21:04.732ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 130.905593ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
65942025-02-28T11:21:04.740ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
65952025-02-28T11:21:04.740ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
65962025-02-28T11:21:04.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65972025-02-28T11:21:04.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65982025-02-28T11:21:04.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65992025-02-28T11:21:04.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66002025-02-28T11:21:04.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66012025-02-28T11:21:04.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66022025-02-28T11:21:04.749ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
66032025-02-28T11:21:04.749ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
66042025-02-28T11:21:04.749ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-28 11:09:18.396893 UTC dns_group = internal generation = 1
66052025-02-28T11:21:04.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 154.10156ms iteration = 13 status = {"generation":1}
66062025-02-28T11:21:04.750ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66072025-02-28T11:21:04.750ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66082025-02-28T11:21:04.750ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.804457ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66092025-02-28T11:21:04.751ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
66102025-02-28T11:21:04.751ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66112025-02-28T11:21:04.751ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "96fcad28-1415-4a4c-ad1c-830735f535ed", "content-length": "26", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} })
66122025-02-28T11:21:04.751ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66132025-02-28T11:21:04.753ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66142025-02-28T11:21:04.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66152025-02-28T11:21:04.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66162025-02-28T11:21:04.787ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 185.952322ms iteration = 28 status = {"physical_disks_added":0}
66172025-02-28T11:21:04.800ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
66182025-02-28T11:21:04.819ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
66192025-02-28T11:21:04.819ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 217.417757ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
66202025-02-28T11:21:04.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66212025-02-28T11:21:04.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66222025-02-28T11:21:04.912ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
66232025-02-28T11:21:04.914ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66242025-02-28T11:21:04.914ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66252025-02-28T11:21:04.915ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "90aa8dc9-e8b7-4fe5-84b3-e87f4895a060", "content-length": "372", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} })
66262025-02-28T11:21:04.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66272025-02-28T11:21:04.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66282025-02-28T11:21:04.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66292025-02-28T11:21:04.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66302025-02-28T11:21:04.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66312025-02-28T11:21:04.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66322025-02-28T11:21:04.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66332025-02-28T11:21:04.920ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
66342025-02-28T11:21:04.920ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66352025-02-28T11:21:04.920ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bf69254-b78d-4d8c-81c4-6e86cff8ff90", "content-length": "26", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} })
66362025-02-28T11:21:04.920ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66372025-02-28T11:21:04.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66382025-02-28T11:21:04.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66392025-02-28T11:21:04.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66402025-02-28T11:21:04.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66412025-02-28T11:21:04.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
66422025-02-28T11:21:04.937ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66432025-02-28T11:21:04.937ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cadbb939-828a-457f-a416-802c0632bd0c", "content-length": "26", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} })
66442025-02-28T11:21:04.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66452025-02-28T11:21:04.939ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
66462025-02-28T11:21:04.945ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 349.427594ms iteration = 25 status = {}
66472025-02-28T11:21:04.963ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
66482025-02-28T11:21:04.963ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66492025-02-28T11:21:04.963ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a3962a88-bc1a-4db2-b76f-95962ca4b9da", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} })
66502025-02-28T11:21:04.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66512025-02-28T11:21:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66522025-02-28T11:21:04.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66532025-02-28T11:21:04.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66542025-02-28T11:21:04.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66552025-02-28T11:21:04.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66562025-02-28T11:21:04.972ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66572025-02-28T11:21:04.972ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66582025-02-28T11:21:04.972ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "610805ad-cc19-4bbe-bcd4-fb63705200f3", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} })
66592025-02-28T11:21:04.974ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 372.558699ms iteration = 26 status = {}
66602025-02-28T11:21:05.014ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
66612025-02-28T11:21:05.015ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "902822f5-d787-47bd-ab90-1c9d674be747", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
66622025-02-28T11:21:05.015ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
66632025-02-28T11:21:05.016ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "142ddb15-4bfc-4cb8-b4df-48696827704d", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
66642025-02-28T11:21:05.016ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
66652025-02-28T11:21:05.018ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
66662025-02-28T11:21:05.018ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 422.57523ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
66672025-02-28T11:21:05.040ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
66682025-02-28T11:21:05.054ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66692025-02-28T11:21:05.056ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66702025-02-28T11:21:05.056ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0518dcc-9cae-4b88-a757-77a12d839504", "content-length": "2", "date": "Fri, 28 Feb 2025 11:21:05 GMT"} })
66712025-02-28T11:21:05.057ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66722025-02-28T11:21:05.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66732025-02-28T11:21:05.059ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 464.240772ms iteration = 25 status = null
66742025-02-28T11:21:05.110ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
66752025-02-28T11:21:05.110ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7aad770c-ec6d-43af-86ee-97990a4b671c", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
66762025-02-28T11:21:05.110ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
66772025-02-28T11:21:05.113ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0d839428-f66c-4a75-bd88-7d45e140e304", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
66782025-02-28T11:21:05.113ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
66792025-02-28T11:21:05.114ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8740ee13-3619-490d-b401-fe126a6997fe", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
66802025-02-28T11:21:05.114ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
66812025-02-28T11:21:05.116ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
66822025-02-28T11:21:05.116ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 520.522588ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
66832025-02-28T11:21:05.119ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "aef9b7e3-4f46-4990-b755-f40f15098776", "content-length": "691", "date": "Fri, 28 Feb 2025 11:21:04 GMT"} })
66842025-02-28T11:21:05.119ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
66852025-02-28T11:21:05.119ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
66862025-02-28T11:21:05.119ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
66872025-02-28T11:21:05.121ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 520.111869ms iteration = 26 status = {}
66882025-02-28T11:21:05.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66892025-02-28T11:21:05.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66902025-02-28T11:21:05.145ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
66912025-02-28T11:21:05.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66922025-02-28T11:21:05.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66932025-02-28T11:21:05.155ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66942025-02-28T11:21:05.155ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea711ae6-de16-4bef-ace8-ea11e42e1052", "content-length": "134", "date": "Fri, 28 Feb 2025 11:21:05 GMT"} })
66952025-02-28T11:21:05.155ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
66962025-02-28T11:21:05.155ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
66972025-02-28T11:21:05.155ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
66982025-02-28T11:21:05.155ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66992025-02-28T11:21:05.155ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67002025-02-28T11:21:05.155ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67012025-02-28T11:21:05.155ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67022025-02-28T11:21:05.155ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67032025-02-28T11:21:05.156ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67042025-02-28T11:21:05.156ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67052025-02-28T11:21:05.156ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
67062025-02-28T11:21:05.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67072025-02-28T11:21:05.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67082025-02-28T11:21:05.158ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67092025-02-28T11:21:05.158ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "290820f5-c10a-4f6a-a50f-799fdf3f765f", "content-length": "2", "date": "Fri, 28 Feb 2025 11:21:05 GMT"} })
67102025-02-28T11:21:05.158ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67112025-02-28T11:21:05.158ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b98b727a-d366-4cf8-a32a-aa77e9955a9d", "content-length": "52", "date": "Fri, 28 Feb 2025 11:21:05 GMT"} })
67122025-02-28T11:21:05.158ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
67132025-02-28T11:21:05.158ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67142025-02-28T11:21:05.251ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "24169b0b-8811-432d-a99e-9c9a114821bf", "date": "Fri, 28 Feb 2025 11:21:05 GMT"} })
67152025-02-28T11:21:05.251ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
67162025-02-28T11:21:05.251ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67172025-02-28T11:21:05.251ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd30a16b-cf27-4569-9d38-94e6561e96d3", "content-length": "682", "date": "Fri, 28 Feb 2025 11:21:05 GMT"} })
67182025-02-28T11:21:05.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67192025-02-28T11:21:05.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67202025-02-28T11:21:05.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67212025-02-28T11:21:05.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67222025-02-28T11:21:05.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67232025-02-28T11:21:05.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67242025-02-28T11:21:05.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67252025-02-28T11:21:05.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67262025-02-28T11:21:05.268ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 666.702267ms iteration = 25 status = {}
67272025-02-28T11:21:05.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 39741510-763d-4f42-996d-ba233a212acc roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67282025-02-28T11:21:05.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 39741510-763d-4f42-996d-ba233a212acc resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67292025-02-28T11:21:05.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2723 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 39741510-763d-4f42-996d-ba233a212acc response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67302025-02-28T11:21:06.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ab8e1963-8f42-4b2e-9e39-19334755b069 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67312025-02-28T11:21:06.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ab8e1963-8f42-4b2e-9e39-19334755b069 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67322025-02-28T11:21:06.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ab8e1963-8f42-4b2e-9e39-19334755b069 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67332025-02-28T11:21:07.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 572 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = a02c813a-b69c-441a-baf5-ab136e67846b response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
67342025-02-28T11:21:07.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4ca93d5e-7121-427d-ad1c-05f77fa9e7cb roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67352025-02-28T11:21:07.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4ca93d5e-7121-427d-ad1c-05f77fa9e7cb resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67362025-02-28T11:21:07.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2652 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4ca93d5e-7121-427d-ad1c-05f77fa9e7cb response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67372025-02-28T11:21:08.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8ca12717-b185-449c-bd6b-93152231ba7a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67382025-02-28T11:21:08.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8ca12717-b185-449c-bd6b-93152231ba7a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67392025-02-28T11:21:08.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8ca12717-b185-449c-bd6b-93152231ba7a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67402025-02-28T11:21:09.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1732bd4a-b9bb-4ba1-ad85-7291d2196d40 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67412025-02-28T11:21:09.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1732bd4a-b9bb-4ba1-ad85-7291d2196d40 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67422025-02-28T11:21:09.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2859 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1732bd4a-b9bb-4ba1-ad85-7291d2196d40 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67432025-02-28T11:21:10.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e8be2784-d27f-435c-81ad-a236a572000a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67442025-02-28T11:21:10.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e8be2784-d27f-435c-81ad-a236a572000a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67452025-02-28T11:21:10.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e8be2784-d27f-435c-81ad-a236a572000a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67462025-02-28T11:21:11.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 374a5ced-7fa8-4852-9ec5-05b50605793f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67472025-02-28T11:21:11.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 374a5ced-7fa8-4852-9ec5-05b50605793f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67482025-02-28T11:21:11.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 374a5ced-7fa8-4852-9ec5-05b50605793f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67492025-02-28T11:21:12.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c13d7ce7-4112-42cb-b88a-97ffe203f85c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67502025-02-28T11:21:12.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c13d7ce7-4112-42cb-b88a-97ffe203f85c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67512025-02-28T11:21:12.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c13d7ce7-4112-42cb-b88a-97ffe203f85c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67522025-02-28T11:21:13.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8e6f63e3-6ee9-4620-ae65-98eebd331fb7 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67532025-02-28T11:21:13.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8e6f63e3-6ee9-4620-ae65-98eebd331fb7 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67542025-02-28T11:21:13.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1946 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8e6f63e3-6ee9-4620-ae65-98eebd331fb7 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67552025-02-28T11:21:14.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
67562025-02-28T11:21:14.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67572025-02-28T11:21:14.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67582025-02-28T11:21:14.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
67592025-02-28T11:21:14.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67602025-02-28T11:21:14.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67612025-02-28T11:21:14.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67622025-02-28T11:21:14.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67632025-02-28T11:21:14.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67642025-02-28T11:21:14.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67652025-02-28T11:21:14.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67662025-02-28T11:21:14.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67672025-02-28T11:21:14.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67682025-02-28T11:21:14.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
67692025-02-28T11:21:14.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67702025-02-28T11:21:14.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67712025-02-28T11:21:14.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
67722025-02-28T11:21:14.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.613081ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
67732025-02-28T11:21:14.631ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67742025-02-28T11:21:14.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67752025-02-28T11:21:14.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.737988ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67762025-02-28T11:21:14.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 038a2121-aab4-4fc6-a48f-7180b48be6b9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67772025-02-28T11:21:14.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 038a2121-aab4-4fc6-a48f-7180b48be6b9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67782025-02-28T11:21:14.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 038a2121-aab4-4fc6-a48f-7180b48be6b9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67792025-02-28T11:21:15.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ddd74534-812c-4c70-8aba-d5a210a96af4 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67802025-02-28T11:21:15.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ddd74534-812c-4c70-8aba-d5a210a96af4 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67812025-02-28T11:21:15.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ddd74534-812c-4c70-8aba-d5a210a96af4 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67822025-02-28T11:21:16.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 38d82b17-eabc-41d4-b326-2b92941a80e1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67832025-02-28T11:21:16.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 38d82b17-eabc-41d4-b326-2b92941a80e1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67842025-02-28T11:21:16.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 38d82b17-eabc-41d4-b326-2b92941a80e1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67852025-02-28T11:21:17.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 934 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 0f88c9a2-9101-4443-ad46-6bca6424647d response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
67862025-02-28T11:21:17.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5262d3c4-2ced-4b19-9aaa-f0f9eb547bce roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67872025-02-28T11:21:17.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5262d3c4-2ced-4b19-9aaa-f0f9eb547bce resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67882025-02-28T11:21:17.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5262d3c4-2ced-4b19-9aaa-f0f9eb547bce response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67892025-02-28T11:21:18.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 53759f0f-3281-4779-927d-c36ee9eb3e1c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67902025-02-28T11:21:18.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 53759f0f-3281-4779-927d-c36ee9eb3e1c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67912025-02-28T11:21:18.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 53759f0f-3281-4779-927d-c36ee9eb3e1c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67922025-02-28T11:21:20.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c2c1fe38-8b1e-4d10-99fc-2b12fa4f232a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67932025-02-28T11:21:20.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c2c1fe38-8b1e-4d10-99fc-2b12fa4f232a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67942025-02-28T11:21:20.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c2c1fe38-8b1e-4d10-99fc-2b12fa4f232a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67952025-02-28T11:21:21.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 776d7440-f8c3-410a-9077-3028c8c2a5a4 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67962025-02-28T11:21:21.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 776d7440-f8c3-410a-9077-3028c8c2a5a4 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67972025-02-28T11:21:21.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 776d7440-f8c3-410a-9077-3028c8c2a5a4 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67982025-02-28T11:21:22.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c7ae045c-6979-47e6-a396-160db82b0fdf roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
67992025-02-28T11:21:22.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c7ae045c-6979-47e6-a396-160db82b0fdf resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68002025-02-28T11:21:22.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c7ae045c-6979-47e6-a396-160db82b0fdf response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68012025-02-28T11:21:23.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f082716b-a820-437d-aa8f-ffa71769b74b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68022025-02-28T11:21:23.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f082716b-a820-437d-aa8f-ffa71769b74b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68032025-02-28T11:21:23.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2167 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f082716b-a820-437d-aa8f-ffa71769b74b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68042025-02-28T11:21:24.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5fe3ef54-195f-4937-9cd8-680bc082b0d2 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68052025-02-28T11:21:24.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5fe3ef54-195f-4937-9cd8-680bc082b0d2 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68062025-02-28T11:21:24.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2073 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5fe3ef54-195f-4937-9cd8-680bc082b0d2 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68072025-02-28T11:21:24.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
68082025-02-28T11:21:24.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68092025-02-28T11:21:24.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68102025-02-28T11:21:24.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
68112025-02-28T11:21:24.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68122025-02-28T11:21:24.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68132025-02-28T11:21:24.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68142025-02-28T11:21:24.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68152025-02-28T11:21:24.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68162025-02-28T11:21:24.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68172025-02-28T11:21:24.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68182025-02-28T11:21:24.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68192025-02-28T11:21:24.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68202025-02-28T11:21:24.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68212025-02-28T11:21:24.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68222025-02-28T11:21:24.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
68232025-02-28T11:21:24.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68242025-02-28T11:21:24.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68252025-02-28T11:21:24.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
68262025-02-28T11:21:24.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.234605ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
68272025-02-28T11:21:24.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.015628ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68282025-02-28T11:21:25.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3b2b556a-6497-4a7a-9169-5e457a17a822 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68292025-02-28T11:21:25.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3b2b556a-6497-4a7a-9169-5e457a17a822 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68302025-02-28T11:21:25.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3b2b556a-6497-4a7a-9169-5e457a17a822 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68312025-02-28T11:21:26.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f7c626b0-2789-44a0-8227-d774161aa8c3 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68322025-02-28T11:21:26.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f7c626b0-2789-44a0-8227-d774161aa8c3 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68332025-02-28T11:21:26.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f7c626b0-2789-44a0-8227-d774161aa8c3 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68342025-02-28T11:21:27.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 562 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = f6f73bbf-dea1-41d1-86c1-720254b7d5db response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
68352025-02-28T11:21:27.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6e2f0fcb-4e16-433c-84f4-b7c1d0950869 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68362025-02-28T11:21:27.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6e2f0fcb-4e16-433c-84f4-b7c1d0950869 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68372025-02-28T11:21:27.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6e2f0fcb-4e16-433c-84f4-b7c1d0950869 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68382025-02-28T11:21:28.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1cda76f0-a275-4e2c-9d37-18b08e11cf12 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68392025-02-28T11:21:28.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1cda76f0-a275-4e2c-9d37-18b08e11cf12 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68402025-02-28T11:21:28.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1cda76f0-a275-4e2c-9d37-18b08e11cf12 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68412025-02-28T11:21:29.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8f6fa5bc-1a41-4c43-bf44-1453410aa8b6 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68422025-02-28T11:21:29.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8f6fa5bc-1a41-4c43-bf44-1453410aa8b6 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68432025-02-28T11:21:29.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8f6fa5bc-1a41-4c43-bf44-1453410aa8b6 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68442025-02-28T11:21:30.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 76849f26-5280-493b-9d97-5670fc96079d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68452025-02-28T11:21:30.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 76849f26-5280-493b-9d97-5670fc96079d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68462025-02-28T11:21:30.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2869 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 76849f26-5280-493b-9d97-5670fc96079d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68472025-02-28T11:21:31.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 737b87d8-d83a-4606-b25d-c25e1ddcddaf roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68482025-02-28T11:21:31.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 737b87d8-d83a-4606-b25d-c25e1ddcddaf resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68492025-02-28T11:21:31.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 737b87d8-d83a-4606-b25d-c25e1ddcddaf response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68502025-02-28T11:21:32.070ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:33792
68512025-02-28T11:21:32.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33792 req_id = c15cc211-0aef-4c68-b164-497b08f63aa3 roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
68522025-02-28T11:21:32.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33792 req_id = c15cc211-0aef-4c68-b164-497b08f63aa3 resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
68532025-02-28T11:21:32.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3252 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33792 req_id = c15cc211-0aef-4c68-b164-497b08f63aa3 response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?sort_by=id_ascending
68542025-02-28T11:21:32.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33792 req_id = b666d3d7-c927-4511-b37d-f9be766caaef roles = RoleSet { roles: {} } uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
68552025-02-28T11:21:32.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33792 req_id = b666d3d7-c927-4511-b37d-f9be766caaef resource = Database result = Ok(()) uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
68562025-02-28T11:21:32.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2747 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33792 req_id = b666d3d7-c927-4511-b37d-f9be766caaef response_code = 200 uri = /metrics/collectors/59e12d21-f0a8-4840-9b1a-87533ec59eae/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkOWY4ZDg4ZC02YmYzLTQxMDYtYjM0My0yMjNjZmZmMzRlYmIifX0%3D
68572025-02-28T11:21:32.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e4fb43a9-8fb3-4520-9f50-360559dde5db roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68582025-02-28T11:21:32.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e4fb43a9-8fb3-4520-9f50-360559dde5db resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68592025-02-28T11:21:32.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2649 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e4fb43a9-8fb3-4520-9f50-360559dde5db response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68602025-02-28T11:21:33.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 925d0988-f07c-48b6-b1f7-d52424017062 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68612025-02-28T11:21:33.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 925d0988-f07c-48b6-b1f7-d52424017062 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68622025-02-28T11:21:33.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2738 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 925d0988-f07c-48b6-b1f7-d52424017062 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68632025-02-28T11:21:34.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 75875e84-223a-49e0-a257-3f9b054213bb roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68642025-02-28T11:21:34.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 75875e84-223a-49e0-a257-3f9b054213bb resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68652025-02-28T11:21:34.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2209 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 75875e84-223a-49e0-a257-3f9b054213bb response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
68662025-02-28T11:21:34.595ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
68672025-02-28T11:21:34.595ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68682025-02-28T11:21:34.595ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
68692025-02-28T11:21:34.595ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68702025-02-28T11:21:34.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68712025-02-28T11:21:34.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
68722025-02-28T11:21:34.597ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
68732025-02-28T11:21:34.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1863, tv_nsec: 146849850 } })
68742025-02-28T11:21:34.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
68752025-02-28T11:21:34.598ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1863, tv_nsec: 147661747 } })
68762025-02-28T11:21:34.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
68772025-02-28T11:21:34.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
68782025-02-28T11:21:34.600ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.460644ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
68792025-02-28T11:21:34.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68802025-02-28T11:21:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68812025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
68822025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
68832025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68842025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68852025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
68862025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68872025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
68882025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68892025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68902025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
68912025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
68922025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
68932025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
68942025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
68952025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68962025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
68972025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
68982025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
68992025-02-28T11:21:34.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69002025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69012025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
69022025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69032025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
69042025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69052025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
69062025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69072025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69082025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
69092025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69102025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
69112025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69122025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
69132025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69142025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69152025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69162025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69172025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69182025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69192025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69202025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69212025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69222025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69232025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
69242025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69252025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69262025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69272025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69282025-02-28T11:21:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69292025-02-28T11:21:34.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69302025-02-28T11:21:34.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69312025-02-28T11:21:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69322025-02-28T11:21:34.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69332025-02-28T11:21:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69342025-02-28T11:21:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
69352025-02-28T11:21:34.606ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69362025-02-28T11:21:34.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69372025-02-28T11:21:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69382025-02-28T11:21:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69392025-02-28T11:21:34.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69402025-02-28T11:21:34.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69412025-02-28T11:21:34.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69422025-02-28T11:21:34.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69432025-02-28T11:21:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69442025-02-28T11:21:34.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69452025-02-28T11:21:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69462025-02-28T11:21:34.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69472025-02-28T11:21:34.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69482025-02-28T11:21:34.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69492025-02-28T11:21:34.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69502025-02-28T11:21:34.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69512025-02-28T11:21:34.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69522025-02-28T11:21:34.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69532025-02-28T11:21:34.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69542025-02-28T11:21:34.617ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69552025-02-28T11:21:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69562025-02-28T11:21:34.621ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69572025-02-28T11:21:34.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69582025-02-28T11:21:34.621ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69592025-02-28T11:21:34.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69602025-02-28T11:21:34.623ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1863, tv_nsec: 172149512 } })
69612025-02-28T11:21:34.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69622025-02-28T11:21:34.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
69632025-02-28T11:21:34.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69642025-02-28T11:21:34.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69652025-02-28T11:21:34.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
69662025-02-28T11:21:34.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69672025-02-28T11:21:34.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69682025-02-28T11:21:34.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.523308ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
69692025-02-28T11:21:34.647ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
69702025-02-28T11:21:34.647ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.921694ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
69712025-02-28T11:21:34.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69722025-02-28T11:21:34.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69732025-02-28T11:21:34.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.680756ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
69742025-02-28T11:21:34.652ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69752025-02-28T11:21:34.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69762025-02-28T11:21:34.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69772025-02-28T11:21:34.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69782025-02-28T11:21:34.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69792025-02-28T11:21:34.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.153018ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
69802025-02-28T11:21:34.655ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69812025-02-28T11:21:34.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69822025-02-28T11:21:34.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69832025-02-28T11:21:34.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69842025-02-28T11:21:34.656ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69852025-02-28T11:21:34.656ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
69862025-02-28T11:21:34.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69872025-02-28T11:21:34.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69882025-02-28T11:21:34.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69892025-02-28T11:21:34.656ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.272382ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69902025-02-28T11:21:34.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69912025-02-28T11:21:34.657ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69922025-02-28T11:21:34.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69932025-02-28T11:21:34.658ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69942025-02-28T11:21:34.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69952025-02-28T11:21:34.659ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69962025-02-28T11:21:34.659ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
69972025-02-28T11:21:34.659ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69982025-02-28T11:21:34.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69992025-02-28T11:21:34.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
70002025-02-28T11:21:34.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70012025-02-28T11:21:34.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70022025-02-28T11:21:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70032025-02-28T11:21:34.661ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70042025-02-28T11:21:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70052025-02-28T11:21:34.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 59.463534ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
70062025-02-28T11:21:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70072025-02-28T11:21:34.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.410852ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70082025-02-28T11:21:34.661ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70092025-02-28T11:21:34.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70102025-02-28T11:21:34.663ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70112025-02-28T11:21:34.663ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.839163ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70122025-02-28T11:21:34.663ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.275652ms iteration = 26 status = 0
70132025-02-28T11:21:34.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70142025-02-28T11:21:34.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70152025-02-28T11:21:34.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70162025-02-28T11:21:34.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70172025-02-28T11:21:34.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70182025-02-28T11:21:34.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70192025-02-28T11:21:34.670ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 68.280092ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
70202025-02-28T11:21:34.680ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
70212025-02-28T11:21:34.680ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70222025-02-28T11:21:34.680ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a38f0af6-c28c-408a-a4f5-7141bdb6bf19", "content-length": "26", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
70232025-02-28T11:21:34.680ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70242025-02-28T11:21:34.682ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70252025-02-28T11:21:34.683ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
70262025-02-28T11:21:34.683ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70272025-02-28T11:21:34.683ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "68b3e0a7-9838-427e-9cc4-fb8799da9046", "content-length": "26", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
70282025-02-28T11:21:34.683ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70292025-02-28T11:21:34.684ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70302025-02-28T11:21:34.694ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
70312025-02-28T11:21:34.694ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 92.854179ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
70322025-02-28T11:21:34.695ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70332025-02-28T11:21:34.695ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70342025-02-28T11:21:34.695ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 93.193106ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70352025-02-28T11:21:34.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70362025-02-28T11:21:34.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70372025-02-28T11:21:34.734ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
70382025-02-28T11:21:34.734ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70392025-02-28T11:21:34.734ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83b78a7d-06ee-4897-8557-b724c9d7ed62", "content-length": "26", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
70402025-02-28T11:21:34.734ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70412025-02-28T11:21:34.735ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
70422025-02-28T11:21:34.766ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 164.036743ms iteration = 29 status = {"physical_disks_added":0}
70432025-02-28T11:21:34.770ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
70442025-02-28T11:21:34.770ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70452025-02-28T11:21:34.797ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70462025-02-28T11:21:34.798ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "84db4ec8-73c1-4407-b1d9-f36856275987", "content-length": "2", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
70472025-02-28T11:21:34.799ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70482025-02-28T11:21:34.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70492025-02-28T11:21:34.801ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 206.162506ms iteration = 26 status = null
70502025-02-28T11:21:34.815ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0003531e-b3b1-4050-bee8-5dcfb0c8fb47", "content-length": "372", "date": "Fri, 28 Feb 2025 11:21:33 GMT"} })
70512025-02-28T11:21:34.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70522025-02-28T11:21:34.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70532025-02-28T11:21:34.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70542025-02-28T11:21:34.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70552025-02-28T11:21:34.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70562025-02-28T11:21:34.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70572025-02-28T11:21:34.828ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70582025-02-28T11:21:34.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70592025-02-28T11:21:34.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70602025-02-28T11:21:34.830ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
70612025-02-28T11:21:34.830ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
70622025-02-28T11:21:34.830ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9f44596e-0d6e-4532-9899-31448a01be13", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
70632025-02-28T11:21:34.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70642025-02-28T11:21:34.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70652025-02-28T11:21:34.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70662025-02-28T11:21:34.831ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70672025-02-28T11:21:34.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70682025-02-28T11:21:34.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70692025-02-28T11:21:34.833ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 237.967276ms iteration = 26 status = {}
70702025-02-28T11:21:34.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70712025-02-28T11:21:34.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70722025-02-28T11:21:34.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70732025-02-28T11:21:34.839ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
70742025-02-28T11:21:34.839ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70752025-02-28T11:21:34.839ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "26e6f2c8-6782-48a6-bdfe-f3c05e3d110e", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
70762025-02-28T11:21:34.841ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 238.847766ms iteration = 27 status = {}
70772025-02-28T11:21:34.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70782025-02-28T11:21:34.893ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "620ea12c-252f-4bb3-91ae-756d95880888", "content-length": "691", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
70792025-02-28T11:21:34.893ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
70802025-02-28T11:21:34.893ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
70812025-02-28T11:21:34.893ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
70822025-02-28T11:21:34.895ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 293.19394ms iteration = 27 status = {}
70832025-02-28T11:21:34.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70842025-02-28T11:21:34.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70852025-02-28T11:21:34.939ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
70862025-02-28T11:21:34.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70872025-02-28T11:21:34.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70882025-02-28T11:21:34.949ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
70892025-02-28T11:21:34.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3b39dc1-97cc-4bfe-8e55-f696bb2947b4", "content-length": "134", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
70902025-02-28T11:21:34.949ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
70912025-02-28T11:21:34.949ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
70922025-02-28T11:21:34.949ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
70932025-02-28T11:21:34.949ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70942025-02-28T11:21:34.949ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70952025-02-28T11:21:34.949ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70962025-02-28T11:21:34.949ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70972025-02-28T11:21:34.949ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70982025-02-28T11:21:34.949ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70992025-02-28T11:21:34.949ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71002025-02-28T11:21:34.950ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
71012025-02-28T11:21:34.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71022025-02-28T11:21:34.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71032025-02-28T11:21:34.952ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71042025-02-28T11:21:34.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6515c5bc-1d9a-4568-81f3-0ce07009a2f6", "content-length": "2", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
71052025-02-28T11:21:34.952ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71062025-02-28T11:21:34.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "46ba5b9a-eab0-4199-9a6c-93956fb69ad1", "content-length": "52", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
71072025-02-28T11:21:34.952ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
71082025-02-28T11:21:34.952ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71092025-02-28T11:21:35.051ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4b679b00-bdf4-4e06-a530-6f554549aa1a", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
71102025-02-28T11:21:35.051ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
71112025-02-28T11:21:35.051ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71122025-02-28T11:21:35.051ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2820e97-2863-42e6-aa08-3be510dc9f03", "content-length": "682", "date": "Fri, 28 Feb 2025 11:21:34 GMT"} })
71132025-02-28T11:21:35.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71142025-02-28T11:21:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71152025-02-28T11:21:35.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71162025-02-28T11:21:35.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71172025-02-28T11:21:35.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71182025-02-28T11:21:35.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71192025-02-28T11:21:35.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71202025-02-28T11:21:35.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71212025-02-28T11:21:35.068ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 466.753526ms iteration = 26 status = {}
71222025-02-28T11:21:35.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8676d5b3-25d4-457e-b4ce-28143042e27d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71232025-02-28T11:21:35.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8676d5b3-25d4-457e-b4ce-28143042e27d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71242025-02-28T11:21:35.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2589 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8676d5b3-25d4-457e-b4ce-28143042e27d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71252025-02-28T11:21:36.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3e35833f-9dd2-4419-a808-bcb1ec94ba5f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71262025-02-28T11:21:36.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3e35833f-9dd2-4419-a808-bcb1ec94ba5f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71272025-02-28T11:21:36.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3e35833f-9dd2-4419-a808-bcb1ec94ba5f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71282025-02-28T11:21:37.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 677 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 3b393b9a-7694-48fd-9f82-bab6000b8286 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
71292025-02-28T11:21:37.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7fc6b01c-77f9-4ccb-ad3a-e94e8e097778 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71302025-02-28T11:21:37.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7fc6b01c-77f9-4ccb-ad3a-e94e8e097778 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71312025-02-28T11:21:37.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7fc6b01c-77f9-4ccb-ad3a-e94e8e097778 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71322025-02-28T11:21:38.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 832e5e60-bd4b-433f-9c94-37eb059cf963 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71332025-02-28T11:21:38.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 832e5e60-bd4b-433f-9c94-37eb059cf963 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71342025-02-28T11:21:38.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2452 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 832e5e60-bd4b-433f-9c94-37eb059cf963 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71352025-02-28T11:21:39.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62845360-0a72-4557-bf5c-9d003f68e590 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71362025-02-28T11:21:39.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62845360-0a72-4557-bf5c-9d003f68e590 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71372025-02-28T11:21:39.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2873 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 62845360-0a72-4557-bf5c-9d003f68e590 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71382025-02-28T11:21:40.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1e666c1c-2409-43cf-90da-4570df1fecfb roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71392025-02-28T11:21:40.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1e666c1c-2409-43cf-90da-4570df1fecfb resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71402025-02-28T11:21:40.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1e666c1c-2409-43cf-90da-4570df1fecfb response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71412025-02-28T11:21:41.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a2bc02d6-af4a-4efd-8dfb-44e4fac9afe1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71422025-02-28T11:21:41.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a2bc02d6-af4a-4efd-8dfb-44e4fac9afe1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71432025-02-28T11:21:41.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2983 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a2bc02d6-af4a-4efd-8dfb-44e4fac9afe1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71442025-02-28T11:21:42.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e035456-8226-4df2-ba4b-634016f67ee8 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71452025-02-28T11:21:42.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e035456-8226-4df2-ba4b-634016f67ee8 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71462025-02-28T11:21:42.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5e035456-8226-4df2-ba4b-634016f67ee8 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71472025-02-28T11:21:43.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1b728665-c81c-4610-8db6-e3bbe9a17e8b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71482025-02-28T11:21:43.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1b728665-c81c-4610-8db6-e3bbe9a17e8b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71492025-02-28T11:21:43.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1b728665-c81c-4610-8db6-e3bbe9a17e8b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71502025-02-28T11:21:44.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e75a0b45-123c-4629-8b23-4be5ea27d6e1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71512025-02-28T11:21:44.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e75a0b45-123c-4629-8b23-4be5ea27d6e1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71522025-02-28T11:21:44.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e75a0b45-123c-4629-8b23-4be5ea27d6e1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71532025-02-28T11:21:44.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
71542025-02-28T11:21:44.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71552025-02-28T11:21:44.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71562025-02-28T11:21:44.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
71572025-02-28T11:21:44.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71582025-02-28T11:21:44.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71592025-02-28T11:21:44.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71602025-02-28T11:21:44.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71612025-02-28T11:21:44.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71622025-02-28T11:21:44.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71632025-02-28T11:21:44.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71642025-02-28T11:21:44.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71652025-02-28T11:21:44.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71662025-02-28T11:21:44.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
71672025-02-28T11:21:44.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71682025-02-28T11:21:44.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71692025-02-28T11:21:44.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
71702025-02-28T11:21:44.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.355792ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
71712025-02-28T11:21:44.637ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71722025-02-28T11:21:44.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71732025-02-28T11:21:44.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.337829ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71742025-02-28T11:21:45.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 08bf9d76-bd70-4ad7-8730-b307d5bb6615 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71752025-02-28T11:21:45.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 08bf9d76-bd70-4ad7-8730-b307d5bb6615 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71762025-02-28T11:21:45.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 08bf9d76-bd70-4ad7-8730-b307d5bb6615 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71772025-02-28T11:21:46.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 522550e5-18f1-4f42-9d0b-dd97d4d1279d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71782025-02-28T11:21:46.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 522550e5-18f1-4f42-9d0b-dd97d4d1279d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71792025-02-28T11:21:46.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2891 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 522550e5-18f1-4f42-9d0b-dd97d4d1279d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71802025-02-28T11:21:47.085ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 652 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = e5d5de94-c2da-4fa2-9360-24f75eac50e0 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
71812025-02-28T11:21:47.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 70988e60-8cd3-433b-92b0-fdeb518e96ce roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71822025-02-28T11:21:47.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 70988e60-8cd3-433b-92b0-fdeb518e96ce resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71832025-02-28T11:21:47.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 70988e60-8cd3-433b-92b0-fdeb518e96ce response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71842025-02-28T11:21:48.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e6def0f6-d58a-409e-afaf-68d913891284 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71852025-02-28T11:21:48.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e6def0f6-d58a-409e-afaf-68d913891284 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71862025-02-28T11:21:48.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2699 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e6def0f6-d58a-409e-afaf-68d913891284 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71872025-02-28T11:21:49.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cca87d8d-2f28-4dba-8ddd-41a8631d174f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71882025-02-28T11:21:49.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cca87d8d-2f28-4dba-8ddd-41a8631d174f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71892025-02-28T11:21:49.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2692 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cca87d8d-2f28-4dba-8ddd-41a8631d174f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71902025-02-28T11:21:50.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 320568c3-c111-4074-800f-689c3ae29508 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71912025-02-28T11:21:50.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 320568c3-c111-4074-800f-689c3ae29508 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71922025-02-28T11:21:50.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 320568c3-c111-4074-800f-689c3ae29508 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71932025-02-28T11:21:51.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0dea28c5-0621-4828-bb91-02e15bca5edf roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71942025-02-28T11:21:51.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0dea28c5-0621-4828-bb91-02e15bca5edf resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71952025-02-28T11:21:51.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0dea28c5-0621-4828-bb91-02e15bca5edf response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71962025-02-28T11:21:52.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7b95941c-a170-4b12-bdc0-d4618b88a887 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71972025-02-28T11:21:52.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7b95941c-a170-4b12-bdc0-d4618b88a887 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71982025-02-28T11:21:52.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2254 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7b95941c-a170-4b12-bdc0-d4618b88a887 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
71992025-02-28T11:21:53.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4d4535d5-60ea-4862-bc9f-4c1cb23a7cf2 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72002025-02-28T11:21:53.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4d4535d5-60ea-4862-bc9f-4c1cb23a7cf2 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72012025-02-28T11:21:53.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2818 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4d4535d5-60ea-4862-bc9f-4c1cb23a7cf2 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72022025-02-28T11:21:54.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
72032025-02-28T11:21:54.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72042025-02-28T11:21:54.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72052025-02-28T11:21:54.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
72062025-02-28T11:21:54.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72072025-02-28T11:21:54.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72082025-02-28T11:21:54.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72092025-02-28T11:21:54.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72102025-02-28T11:21:54.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72112025-02-28T11:21:54.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72122025-02-28T11:21:54.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72132025-02-28T11:21:54.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72142025-02-28T11:21:54.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 7.494861ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72152025-02-28T11:21:54.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72162025-02-28T11:21:54.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72172025-02-28T11:21:54.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72182025-02-28T11:21:54.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
72192025-02-28T11:21:54.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72202025-02-28T11:21:54.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72212025-02-28T11:21:54.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
72222025-02-28T11:21:54.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.397606ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
72232025-02-28T11:21:54.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2731a715-5ea3-4582-ae7f-5b2ac31f8f6b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72242025-02-28T11:21:54.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2731a715-5ea3-4582-ae7f-5b2ac31f8f6b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72252025-02-28T11:21:54.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1844 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2731a715-5ea3-4582-ae7f-5b2ac31f8f6b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72262025-02-28T11:21:55.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1b1e10c0-1827-40ff-9257-9b84954d3e69 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72272025-02-28T11:21:55.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1b1e10c0-1827-40ff-9257-9b84954d3e69 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72282025-02-28T11:21:55.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1b1e10c0-1827-40ff-9257-9b84954d3e69 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72292025-02-28T11:21:56.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 61484215-7266-4260-8fbe-60c34cd606df roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72302025-02-28T11:21:56.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 61484215-7266-4260-8fbe-60c34cd606df resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72312025-02-28T11:21:56.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 61484215-7266-4260-8fbe-60c34cd606df response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72322025-02-28T11:21:57.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 582 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 2f8b66b5-7ce7-41b8-a9fd-1f4f197457de response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
72332025-02-28T11:21:57.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fb0880ad-169a-4e14-acc0-e446d4fb8c65 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72342025-02-28T11:21:57.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fb0880ad-169a-4e14-acc0-e446d4fb8c65 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72352025-02-28T11:21:57.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fb0880ad-169a-4e14-acc0-e446d4fb8c65 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72362025-02-28T11:21:58.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 06e97225-166b-470d-b653-954ae4c6192c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72372025-02-28T11:21:58.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 06e97225-166b-470d-b653-954ae4c6192c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72382025-02-28T11:21:58.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 06e97225-166b-470d-b653-954ae4c6192c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72392025-02-28T11:21:59.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 891299c0-6610-4866-a671-5b12cc8f8805 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72402025-02-28T11:21:59.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 891299c0-6610-4866-a671-5b12cc8f8805 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72412025-02-28T11:21:59.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2737 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 891299c0-6610-4866-a671-5b12cc8f8805 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72422025-02-28T11:22:00.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 37bd0be6-7fe5-4b97-8fa8-dcb43d28462b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72432025-02-28T11:22:00.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 37bd0be6-7fe5-4b97-8fa8-dcb43d28462b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72442025-02-28T11:22:00.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 37bd0be6-7fe5-4b97-8fa8-dcb43d28462b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72452025-02-28T11:22:01.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cf2bbd7e-6956-46ac-8b34-3f58f64875b6 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72462025-02-28T11:22:01.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cf2bbd7e-6956-46ac-8b34-3f58f64875b6 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72472025-02-28T11:22:01.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = cf2bbd7e-6956-46ac-8b34-3f58f64875b6 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72482025-02-28T11:22:02.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 127f2a16-48b8-4e37-83ed-74bb59fe5044 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72492025-02-28T11:22:02.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 127f2a16-48b8-4e37-83ed-74bb59fe5044 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72502025-02-28T11:22:02.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 127f2a16-48b8-4e37-83ed-74bb59fe5044 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72512025-02-28T11:22:03.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 57b9d6b8-8ed0-4121-bf1b-e1d0d1dcdd61 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72522025-02-28T11:22:03.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 57b9d6b8-8ed0-4121-bf1b-e1d0d1dcdd61 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72532025-02-28T11:22:03.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 57b9d6b8-8ed0-4121-bf1b-e1d0d1dcdd61 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
72542025-02-28T11:22:04.595ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
72552025-02-28T11:22:04.595ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72562025-02-28T11:22:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
72572025-02-28T11:22:04.595ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
72582025-02-28T11:22:04.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72592025-02-28T11:22:04.595ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
72602025-02-28T11:22:04.595ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
72612025-02-28T11:22:04.595ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
72622025-02-28T11:22:04.595ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72632025-02-28T11:22:04.595ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-02-28 11:12:04.595909385 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
72642025-02-28T11:22:04.595ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
72652025-02-28T11:22:04.595ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
72662025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72672025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
72682025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
72692025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
72702025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
72712025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72722025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
72732025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72742025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72752025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72762025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72772025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
72782025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72792025-02-28T11:22:04.596ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cd949b0-a160-497e-a9d3-708f380c3425.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("441521c3-bf8d-4bb0-a351-260cd1158738.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1893, tv_nsec: 145401644 } })
72802025-02-28T11:22:04.596ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c58b6d59-7cb2-478f-9d27-4e70c13f0853.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("daf1508c-21c6-4c2b-91a0-3e717092a118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9dfcf5e-a922-4658-a776-3618551edd74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1893, tv_nsec: 145596548 } })
72812025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
72822025-02-28T11:22:04.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.050163ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
72832025-02-28T11:22:04.597ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
72842025-02-28T11:22:04.597ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.253267ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
72852025-02-28T11:22:04.597ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
72862025-02-28T11:22:04.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72872025-02-28T11:22:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72882025-02-28T11:22:04.598ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1893, tv_nsec: 147470259 } })
72892025-02-28T11:22:04.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72902025-02-28T11:22:04.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
72912025-02-28T11:22:04.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72922025-02-28T11:22:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72932025-02-28T11:22:04.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72942025-02-28T11:22:04.600ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72952025-02-28T11:22:04.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
72962025-02-28T11:22:04.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72972025-02-28T11:22:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72982025-02-28T11:22:04.600ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-02-28 11:12:04.595909385 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
72992025-02-28T11:22:04.600ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.6861ms iteration = 14 status = {"expiration":"2025-02-28T11:12:04.595909385Z","pruned":[]}
73002025-02-28T11:22:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73012025-02-28T11:22:04.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1893, tv_nsec: 149735767 } })
73022025-02-28T11:22:04.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
73032025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
73042025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73052025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
73062025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
73072025-02-28T11:22:04.602ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
73082025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
73092025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
73102025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
73112025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
73122025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
73132025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73142025-02-28T11:22:04.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
73152025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73162025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
73172025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73182025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
73192025-02-28T11:22:04.602ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 7549b177-a582-4102-91fb-b7e6324fd615
73202025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.28\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"7549b177-a582-4102-91fb-b7e6324fd615"}
73212025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
73222025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73232025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73242025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
73252025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73262025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
73272025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
73282025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
73292025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
73302025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
73312025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73322025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
73332025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
73342025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
73352025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73362025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
73372025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
73382025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
73392025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73402025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
73412025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
73422025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
73432025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73442025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
73452025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
73462025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73472025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73482025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73492025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73502025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
73512025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
73522025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73532025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73542025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73552025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73562025-02-28T11:22:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73572025-02-28T11:22:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
73582025-02-28T11:22:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
73592025-02-28T11:22:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
73602025-02-28T11:22:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73612025-02-28T11:22:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
73622025-02-28T11:22:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73632025-02-28T11:22:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73642025-02-28T11:22:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73652025-02-28T11:22:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
73662025-02-28T11:22:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73672025-02-28T11:22:04.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73682025-02-28T11:22:04.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73692025-02-28T11:22:04.604ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.156313ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
73702025-02-28T11:22:04.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73712025-02-28T11:22:04.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73722025-02-28T11:22:04.608ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73732025-02-28T11:22:04.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73742025-02-28T11:22:04.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73752025-02-28T11:22:04.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73762025-02-28T11:22:04.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73772025-02-28T11:22:04.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73782025-02-28T11:22:04.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
73792025-02-28T11:22:04.610ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
73802025-02-28T11:22:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
73812025-02-28T11:22:04.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73822025-02-28T11:22:04.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73832025-02-28T11:22:04.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73842025-02-28T11:22:04.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73852025-02-28T11:22:04.617ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.95039ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
73862025-02-28T11:22:04.618ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
73872025-02-28T11:22:04.618ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
73882025-02-28T11:22:04.618ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.263428ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
73892025-02-28T11:22:04.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.98362ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73902025-02-28T11:22:04.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73912025-02-28T11:22:04.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73922025-02-28T11:22:04.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
73932025-02-28T11:22:04.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73942025-02-28T11:22:04.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73952025-02-28T11:22:04.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73962025-02-28T11:22:04.656ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73972025-02-28T11:22:04.656ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73982025-02-28T11:22:04.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73992025-02-28T11:22:04.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74002025-02-28T11:22:04.657ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
74012025-02-28T11:22:04.657ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
74022025-02-28T11:22:04.657ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
74032025-02-28T11:22:04.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74042025-02-28T11:22:04.657ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74052025-02-28T11:22:04.657ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1893, tv_nsec: 206296399 } })
74062025-02-28T11:22:04.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74072025-02-28T11:22:04.657ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
74082025-02-28T11:22:04.658ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
74092025-02-28T11:22:04.658ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
74102025-02-28T11:22:04.658ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
74112025-02-28T11:22:04.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74122025-02-28T11:22:04.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74132025-02-28T11:22:04.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
74142025-02-28T11:22:04.659ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74152025-02-28T11:22:04.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74162025-02-28T11:22:04.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74172025-02-28T11:22:04.660ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74182025-02-28T11:22:04.660ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
74192025-02-28T11:22:04.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74202025-02-28T11:22:04.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74212025-02-28T11:22:04.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74222025-02-28T11:22:04.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74232025-02-28T11:22:04.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74242025-02-28T11:22:04.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74252025-02-28T11:22:04.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74262025-02-28T11:22:04.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74272025-02-28T11:22:04.665ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 63.467079ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
74282025-02-28T11:22:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74292025-02-28T11:22:04.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74302025-02-28T11:22:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74312025-02-28T11:22:04.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74322025-02-28T11:22:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74332025-02-28T11:22:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74342025-02-28T11:22:04.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
74352025-02-28T11:22:04.668ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74362025-02-28T11:22:04.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.664158ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
74372025-02-28T11:22:04.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74382025-02-28T11:22:04.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74392025-02-28T11:22:04.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74402025-02-28T11:22:04.675ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74412025-02-28T11:22:04.675ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
74422025-02-28T11:22:04.675ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74432025-02-28T11:22:04.675ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74442025-02-28T11:22:04.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74452025-02-28T11:22:04.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74462025-02-28T11:22:04.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74472025-02-28T11:22:04.678ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74482025-02-28T11:22:04.678ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.427167ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
74492025-02-28T11:22:04.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74502025-02-28T11:22:04.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
74512025-02-28T11:22:04.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74522025-02-28T11:22:04.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74532025-02-28T11:22:04.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74542025-02-28T11:22:04.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74552025-02-28T11:22:04.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.483345ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74562025-02-28T11:22:04.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
74572025-02-28T11:22:04.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74582025-02-28T11:22:04.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74592025-02-28T11:22:04.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74602025-02-28T11:22:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74612025-02-28T11:22:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74622025-02-28T11:22:04.687ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
74632025-02-28T11:22:04.687ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
74642025-02-28T11:22:04.687ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.01921ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
74652025-02-28T11:22:04.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74662025-02-28T11:22:04.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74672025-02-28T11:22:04.692ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
74682025-02-28T11:22:04.692ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.671131ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
74692025-02-28T11:22:04.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74702025-02-28T11:22:04.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74712025-02-28T11:22:04.712ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
74722025-02-28T11:22:04.712ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 0 version = 2
74732025-02-28T11:22:04.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74742025-02-28T11:22:04.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74752025-02-28T11:22:04.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74762025-02-28T11:22:04.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74772025-02-28T11:22:04.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74782025-02-28T11:22:04.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74792025-02-28T11:22:04.720ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74802025-02-28T11:22:04.720ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 118.329715ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74812025-02-28T11:22:04.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74822025-02-28T11:22:04.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74832025-02-28T11:22:04.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74842025-02-28T11:22:04.721ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74852025-02-28T11:22:04.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74862025-02-28T11:22:04.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74872025-02-28T11:22:04.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74882025-02-28T11:22:04.726ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74892025-02-28T11:22:04.726ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74902025-02-28T11:22:04.726ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.997816ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74912025-02-28T11:22:04.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74922025-02-28T11:22:04.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
74932025-02-28T11:22:04.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74942025-02-28T11:22:04.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74952025-02-28T11:22:04.759ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
74962025-02-28T11:22:04.769ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
74972025-02-28T11:22:04.769ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74982025-02-28T11:22:04.769ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f7bee19-b3d1-4882-bed4-361daab8efb8", "content-length": "26", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} })
74992025-02-28T11:22:04.769ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75002025-02-28T11:22:04.771ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75012025-02-28T11:22:04.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75022025-02-28T11:22:04.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75032025-02-28T11:22:04.828ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 226.149844ms iteration = 30 status = {"physical_disks_added":0}
75042025-02-28T11:22:04.829ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
75052025-02-28T11:22:04.829ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 227.330589ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
75062025-02-28T11:22:04.900ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75072025-02-28T11:22:04.900ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75082025-02-28T11:22:04.901ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5ad1f0d-d530-4f1a-bb92-8c420ca101dd", "content-length": "372", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} })
75092025-02-28T11:22:04.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75102025-02-28T11:22:04.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75112025-02-28T11:22:04.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75122025-02-28T11:22:04.903ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75132025-02-28T11:22:04.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75142025-02-28T11:22:04.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75152025-02-28T11:22:04.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
75162025-02-28T11:22:04.905ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75172025-02-28T11:22:04.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75182025-02-28T11:22:04.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75192025-02-28T11:22:04.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75202025-02-28T11:22:04.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75212025-02-28T11:22:04.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75222025-02-28T11:22:04.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75232025-02-28T11:22:04.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75242025-02-28T11:22:04.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75252025-02-28T11:22:04.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75262025-02-28T11:22:04.913ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3d771dc3-ccad-48cf-97f6-31d31cbfd186 dns_zone_name = oxide.test found_so_far = 1 version = 2
75272025-02-28T11:22:04.913ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
75282025-02-28T11:22:04.913ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-02-28 11:09:19.025515 UTC dns_group = external generation = 2
75292025-02-28T11:22:04.913ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 317.166463ms iteration = 14 status = {"generation":2}
75302025-02-28T11:22:04.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
75312025-02-28T11:22:04.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75322025-02-28T11:22:04.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75332025-02-28T11:22:04.916ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 313.554526ms iteration = 27 status = 0
75342025-02-28T11:22:04.928ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
75352025-02-28T11:22:04.928ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 328.114657ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
75362025-02-28T11:22:04.937ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
75372025-02-28T11:22:04.937ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "70f91ca4-4e6b-4601-9912-f3b06b2502f5", "content-length": "2", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} })
75382025-02-28T11:22:04.939ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
75392025-02-28T11:22:04.939ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
75402025-02-28T11:22:04.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75412025-02-28T11:22:04.939ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75422025-02-28T11:22:04.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75432025-02-28T11:22:04.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75442025-02-28T11:22:04.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0b31f56a-2ade-40eb-9de8-2b5ac8c5089a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
75452025-02-28T11:22:04.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0b31f56a-2ade-40eb-9de8-2b5ac8c5089a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
75462025-02-28T11:22:04.942ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 346.739326ms iteration = 27 status = null
75472025-02-28T11:22:04.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2564 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 0b31f56a-2ade-40eb-9de8-2b5ac8c5089a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
75482025-02-28T11:22:04.945ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 343.347543ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
75492025-02-28T11:22:04.947ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
75502025-02-28T11:22:04.954ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
75512025-02-28T11:22:04.954ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 351.933788ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
75522025-02-28T11:22:04.958ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-02-28T11:09:02.015184Z, time_modified: 2025-02-28T11:09:02.015184Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, db_silo: Silo { identity: SiloIdentity { id: 2a7a83da-ee54-40e9-893a-6d37cebf3833, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-02-28T11:09:18.984399Z, time_modified: 2025-02-28T11:09:18.984399Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c" }] }) }
75532025-02-28T11:22:04.958ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 362.618746ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]}},"default_endpoint":{"silo_id":"2a7a83da-ee54-40e9-893a-6d37cebf3833","tls_certs":["bb39cce1eebf6e4daa936fceb37fce871cdea4b7323f790cbdaf10df6e139c5c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
75542025-02-28T11:22:04.962ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
75552025-02-28T11:22:04.962ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
75562025-02-28T11:22:04.962ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f37bf1ac-dfc7-4fa6-aae7-90f9a90b4076", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} })
75572025-02-28T11:22:04.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75582025-02-28T11:22:04.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75592025-02-28T11:22:04.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75602025-02-28T11:22:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75612025-02-28T11:22:04.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75622025-02-28T11:22:04.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75632025-02-28T11:22:04.970ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
75642025-02-28T11:22:04.971ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
75652025-02-28T11:22:04.971ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75662025-02-28T11:22:04.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75672025-02-28T11:22:04.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75682025-02-28T11:22:04.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75692025-02-28T11:22:04.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75702025-02-28T11:22:04.983ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = d8f8bdf5-cdb3-4414-98ee-ef7f0ba7150c dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
75712025-02-28T11:22:04.983ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
75722025-02-28T11:22:04.983ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-02-28 11:09:18.396893 UTC dns_group = internal generation = 1
75732025-02-28T11:22:04.983ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 387.573761ms iteration = 14 status = {"generation":1}
75742025-02-28T11:22:05.006ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
75752025-02-28T11:22:05.006ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75762025-02-28T11:22:05.006ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d397558-6ef1-4d9e-888f-61a47075106c", "content-length": "26", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} })
75772025-02-28T11:22:05.006ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75782025-02-28T11:22:05.008ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
75792025-02-28T11:22:05.008ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75802025-02-28T11:22:05.008ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "198e99be-3862-45dd-9794-b4b839c42953", "content-length": "26", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} })
75812025-02-28T11:22:05.008ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75822025-02-28T11:22:05.008ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
75832025-02-28T11:22:05.010ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75842025-02-28T11:22:05.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75852025-02-28T11:22:05.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75862025-02-28T11:22:05.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75872025-02-28T11:22:05.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75882025-02-28T11:22:05.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75892025-02-28T11:22:05.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75902025-02-28T11:22:05.022ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75912025-02-28T11:22:05.025ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75922025-02-28T11:22:05.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75932025-02-28T11:22:05.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75942025-02-28T11:22:05.058ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3d660fda-367b-419a-81b4-380f6dd4c093", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} })
75952025-02-28T11:22:05.059ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 457.538329ms iteration = 28 status = {}
75962025-02-28T11:22:05.079ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
75972025-02-28T11:22:05.080ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1cacd2a3-a7a1-4990-9e04-22bf436af796", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75982025-02-28T11:22:05.080ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
75992025-02-28T11:22:05.082ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "36bcac74-72d6-4bd8-85eb-1d78f4b4b08b", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
76002025-02-28T11:22:05.082ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
76012025-02-28T11:22:05.084ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3aea8cb5-778c-4327-bebc-0352900a5b80", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
76022025-02-28T11:22:05.084ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
76032025-02-28T11:22:05.085ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
76042025-02-28T11:22:05.085ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 489.894452ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
76052025-02-28T11:22:05.142ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 546.571566ms iteration = 27 status = {}
76062025-02-28T11:22:05.210ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
76072025-02-28T11:22:05.210ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "33b424f1-c10a-4b0e-8756-f844bedcac4d", "date": "Fri, 28 Feb 2025 11:22:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76082025-02-28T11:22:05.211ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76092025-02-28T11:22:05.213ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0c016c3f-1400-473b-b834-2c84f058edae", "date": "Fri, 28 Feb 2025 11:22:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76102025-02-28T11:22:05.213ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76112025-02-28T11:22:05.215ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
76122025-02-28T11:22:05.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 619.340505ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
76132025-02-28T11:22:05.223ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76142025-02-28T11:22:05.224ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d05f3eb0-61ad-4c5d-a825-8dd7fb05a7e3", "content-length": "691", "date": "Fri, 28 Feb 2025 11:22:05 GMT"} })
76152025-02-28T11:22:05.224ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
76162025-02-28T11:22:05.224ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
76172025-02-28T11:22:05.224ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
76182025-02-28T11:22:05.226ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 624.041855ms iteration = 28 status = {}
76192025-02-28T11:22:05.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76202025-02-28T11:22:05.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76212025-02-28T11:22:05.257ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
76222025-02-28T11:22:05.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76232025-02-28T11:22:05.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76242025-02-28T11:22:05.267ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76252025-02-28T11:22:05.268ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6aa1da3d-f8d1-4b1c-a59e-09c5a3ffb6f6", "content-length": "134", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} })
76262025-02-28T11:22:05.268ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76272025-02-28T11:22:05.268ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
76282025-02-28T11:22:05.268ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76292025-02-28T11:22:05.268ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76302025-02-28T11:22:05.268ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76312025-02-28T11:22:05.268ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76322025-02-28T11:22:05.268ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76332025-02-28T11:22:05.268ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76342025-02-28T11:22:05.268ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76352025-02-28T11:22:05.268ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76362025-02-28T11:22:05.268ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
76372025-02-28T11:22:05.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76382025-02-28T11:22:05.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76392025-02-28T11:22:05.271ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76402025-02-28T11:22:05.271ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff20567b-66d6-4c37-9518-47f03d81cc52", "content-length": "2", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} })
76412025-02-28T11:22:05.271ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76422025-02-28T11:22:05.271ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9ae0102-b78a-46a4-8dd1-dcd752e0e6c2", "content-length": "52", "date": "Fri, 28 Feb 2025 11:22:04 GMT"} })
76432025-02-28T11:22:05.271ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
76442025-02-28T11:22:05.271ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76452025-02-28T11:22:05.362ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "25e675c5-1c79-41db-8263-104f4523b43b", "date": "Fri, 28 Feb 2025 11:22:05 GMT"} })
76462025-02-28T11:22:05.362ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
76472025-02-28T11:22:05.362ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76482025-02-28T11:22:05.362ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d176d52-e11a-4c01-95b7-9c0a2da40054", "content-length": "682", "date": "Fri, 28 Feb 2025 11:22:05 GMT"} })
76492025-02-28T11:22:05.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76502025-02-28T11:22:05.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76512025-02-28T11:22:05.366ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76522025-02-28T11:22:05.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76532025-02-28T11:22:05.370ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76542025-02-28T11:22:05.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76552025-02-28T11:22:05.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76562025-02-28T11:22:05.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76572025-02-28T11:22:05.380ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 777.86118ms iteration = 27 status = {}
76582025-02-28T11:22:05.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e5b71b1b-00d3-4e0b-8bc2-83f8ba8c8e58 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76592025-02-28T11:22:05.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e5b71b1b-00d3-4e0b-8bc2-83f8ba8c8e58 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76602025-02-28T11:22:05.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2093 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e5b71b1b-00d3-4e0b-8bc2-83f8ba8c8e58 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76612025-02-28T11:22:06.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 89308d44-6b07-419b-9c7f-81f9ab3e8173 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76622025-02-28T11:22:06.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 89308d44-6b07-419b-9c7f-81f9ab3e8173 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76632025-02-28T11:22:06.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2571 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 89308d44-6b07-419b-9c7f-81f9ab3e8173 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76642025-02-28T11:22:07.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 627 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = 60144280-b752-492e-b55e-205855ad2b31 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
76652025-02-28T11:22:08.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c9ad1b5d-9f87-441f-9ed7-158f5da2537e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76662025-02-28T11:22:08.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c9ad1b5d-9f87-441f-9ed7-158f5da2537e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76672025-02-28T11:22:08.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2931 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c9ad1b5d-9f87-441f-9ed7-158f5da2537e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76682025-02-28T11:22:09.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 70b09be7-b7f5-4b27-ac9e-2c4c8bf3a00b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76692025-02-28T11:22:09.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 70b09be7-b7f5-4b27-ac9e-2c4c8bf3a00b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76702025-02-28T11:22:09.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2763 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 70b09be7-b7f5-4b27-ac9e-2c4c8bf3a00b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76712025-02-28T11:22:10.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4dbeb2a3-3cfd-4961-9968-73bfa3530278 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76722025-02-28T11:22:10.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4dbeb2a3-3cfd-4961-9968-73bfa3530278 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76732025-02-28T11:22:10.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4dbeb2a3-3cfd-4961-9968-73bfa3530278 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76742025-02-28T11:22:11.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 74ddaf64-c38c-470c-9cf4-f04c5c059c9b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76752025-02-28T11:22:11.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 74ddaf64-c38c-470c-9cf4-f04c5c059c9b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76762025-02-28T11:22:11.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 74ddaf64-c38c-470c-9cf4-f04c5c059c9b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76772025-02-28T11:22:12.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f5e39d2e-a29a-487a-b839-863872055be5 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76782025-02-28T11:22:12.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f5e39d2e-a29a-487a-b839-863872055be5 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76792025-02-28T11:22:12.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f5e39d2e-a29a-487a-b839-863872055be5 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76802025-02-28T11:22:13.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b743943e-faec-4c56-869b-bf4cb13a0473 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76812025-02-28T11:22:13.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b743943e-faec-4c56-869b-bf4cb13a0473 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76822025-02-28T11:22:13.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b743943e-faec-4c56-869b-bf4cb13a0473 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76832025-02-28T11:22:14.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7ee97923-f6d6-4df3-b4a8-20f8704db98c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76842025-02-28T11:22:14.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7ee97923-f6d6-4df3-b4a8-20f8704db98c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76852025-02-28T11:22:14.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2452 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7ee97923-f6d6-4df3-b4a8-20f8704db98c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
76862025-02-28T11:22:14.600ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
76872025-02-28T11:22:14.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76882025-02-28T11:22:14.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76892025-02-28T11:22:14.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
76902025-02-28T11:22:14.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76912025-02-28T11:22:14.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76922025-02-28T11:22:14.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76932025-02-28T11:22:14.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76942025-02-28T11:22:14.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76952025-02-28T11:22:14.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76962025-02-28T11:22:14.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76972025-02-28T11:22:14.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76982025-02-28T11:22:14.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76992025-02-28T11:22:14.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
77002025-02-28T11:22:14.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77012025-02-28T11:22:14.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77022025-02-28T11:22:14.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
77032025-02-28T11:22:14.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.088693ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
77042025-02-28T11:22:14.632ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77052025-02-28T11:22:14.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77062025-02-28T11:22:14.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.688527ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77072025-02-28T11:22:15.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b9163f83-6e5f-436d-ab58-8867dc8fd794 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77082025-02-28T11:22:15.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b9163f83-6e5f-436d-ab58-8867dc8fd794 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77092025-02-28T11:22:15.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2842 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = b9163f83-6e5f-436d-ab58-8867dc8fd794 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77102025-02-28T11:22:16.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6c890bc9-000c-4754-b572-11d893869c8a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77112025-02-28T11:22:16.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6c890bc9-000c-4754-b572-11d893869c8a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77122025-02-28T11:22:16.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1958 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6c890bc9-000c-4754-b572-11d893869c8a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77132025-02-28T11:22:17.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 677 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = d1e7ac27-3d00-4b8e-9671-cf84d44763b1 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
77142025-02-28T11:22:17.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 24198a05-e0ce-4a31-8ffe-ccb392adafe1 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77152025-02-28T11:22:17.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 24198a05-e0ce-4a31-8ffe-ccb392adafe1 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77162025-02-28T11:22:17.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2516 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 24198a05-e0ce-4a31-8ffe-ccb392adafe1 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77172025-02-28T11:22:18.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7a257a20-ed54-4ed9-bfb3-bac0aea54c0f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77182025-02-28T11:22:18.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7a257a20-ed54-4ed9-bfb3-bac0aea54c0f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77192025-02-28T11:22:18.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2753 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7a257a20-ed54-4ed9-bfb3-bac0aea54c0f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77202025-02-28T11:22:19.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f4935470-06df-4d16-b155-bc77ba5209fe roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77212025-02-28T11:22:19.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f4935470-06df-4d16-b155-bc77ba5209fe resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77222025-02-28T11:22:19.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f4935470-06df-4d16-b155-bc77ba5209fe response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77232025-02-28T11:22:20.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6be754b3-b1f0-428e-a121-c80371b74b88 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77242025-02-28T11:22:20.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6be754b3-b1f0-428e-a121-c80371b74b88 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77252025-02-28T11:22:20.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2745 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6be754b3-b1f0-428e-a121-c80371b74b88 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77262025-02-28T11:22:21.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a3fe79e2-e65a-4b52-8fcf-e2ad6d13f61d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77272025-02-28T11:22:21.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a3fe79e2-e65a-4b52-8fcf-e2ad6d13f61d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77282025-02-28T11:22:21.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a3fe79e2-e65a-4b52-8fcf-e2ad6d13f61d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77292025-02-28T11:22:22.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a9d27501-47e2-4300-8ed6-505624bcebb9 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77302025-02-28T11:22:22.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a9d27501-47e2-4300-8ed6-505624bcebb9 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77312025-02-28T11:22:22.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a9d27501-47e2-4300-8ed6-505624bcebb9 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77322025-02-28T11:22:23.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c34441c5-da9c-4fe5-b678-5b5c3c195e92 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77332025-02-28T11:22:23.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c34441c5-da9c-4fe5-b678-5b5c3c195e92 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77342025-02-28T11:22:23.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = c34441c5-da9c-4fe5-b678-5b5c3c195e92 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77352025-02-28T11:22:24.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7be11220-5c4f-4dbf-ad1a-85fe8a4cf03f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77362025-02-28T11:22:24.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7be11220-5c4f-4dbf-ad1a-85fe8a4cf03f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77372025-02-28T11:22:24.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7be11220-5c4f-4dbf-ad1a-85fe8a4cf03f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77382025-02-28T11:22:24.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
77392025-02-28T11:22:24.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
77402025-02-28T11:22:24.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77412025-02-28T11:22:24.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77422025-02-28T11:22:24.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77432025-02-28T11:22:24.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77442025-02-28T11:22:24.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77452025-02-28T11:22:24.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77462025-02-28T11:22:24.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77472025-02-28T11:22:24.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77482025-02-28T11:22:24.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77492025-02-28T11:22:24.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77502025-02-28T11:22:24.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77512025-02-28T11:22:24.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77522025-02-28T11:22:24.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77532025-02-28T11:22:24.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
77542025-02-28T11:22:24.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77552025-02-28T11:22:24.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77562025-02-28T11:22:24.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
77572025-02-28T11:22:24.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.007959ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
77582025-02-28T11:22:24.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.491644ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77592025-02-28T11:22:25.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fd4205de-6e69-487f-8e7d-7233a565983d roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77602025-02-28T11:22:25.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fd4205de-6e69-487f-8e7d-7233a565983d resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77612025-02-28T11:22:25.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fd4205de-6e69-487f-8e7d-7233a565983d response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77622025-02-28T11:22:26.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1578ebfd-f362-4119-818a-080a504eb720 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77632025-02-28T11:22:26.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1578ebfd-f362-4119-818a-080a504eb720 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77642025-02-28T11:22:26.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2128 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1578ebfd-f362-4119-818a-080a504eb720 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77652025-02-28T11:22:27.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 646 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = c312ba29-e4f9-4c2e-88be-58befb9d3025 response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
77662025-02-28T11:22:27.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f3303cbd-54b5-43d6-80a8-24ec7441fc3a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77672025-02-28T11:22:27.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f3303cbd-54b5-43d6-80a8-24ec7441fc3a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77682025-02-28T11:22:27.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2379 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f3303cbd-54b5-43d6-80a8-24ec7441fc3a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77692025-02-28T11:22:28.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5a47947a-f4f2-4d2e-83f9-1dbbcb82beca roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77702025-02-28T11:22:28.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5a47947a-f4f2-4d2e-83f9-1dbbcb82beca resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77712025-02-28T11:22:28.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5a47947a-f4f2-4d2e-83f9-1dbbcb82beca response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77722025-02-28T11:22:29.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e0b99f00-e2cb-4885-be65-5444681d7b57 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77732025-02-28T11:22:29.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e0b99f00-e2cb-4885-be65-5444681d7b57 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77742025-02-28T11:22:29.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3108 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e0b99f00-e2cb-4885-be65-5444681d7b57 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77752025-02-28T11:22:30.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e06dc9a2-b6f5-46a9-98eb-2e4ba4191d4c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77762025-02-28T11:22:30.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e06dc9a2-b6f5-46a9-98eb-2e4ba4191d4c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77772025-02-28T11:22:30.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e06dc9a2-b6f5-46a9-98eb-2e4ba4191d4c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77782025-02-28T11:22:31.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 26ff888c-1e0b-4505-879d-d15a911d0094 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77792025-02-28T11:22:31.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 26ff888c-1e0b-4505-879d-d15a911d0094 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77802025-02-28T11:22:31.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2094 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 26ff888c-1e0b-4505-879d-d15a911d0094 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77812025-02-28T11:22:32.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2994d068-c28b-4d38-a64c-7c54e0e92fb4 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77822025-02-28T11:22:32.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2994d068-c28b-4d38-a64c-7c54e0e92fb4 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77832025-02-28T11:22:32.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2994d068-c28b-4d38-a64c-7c54e0e92fb4 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77842025-02-28T11:22:33.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = baf3c1ab-a7a2-4e25-8049-e38252bf7e19 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77852025-02-28T11:22:33.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = baf3c1ab-a7a2-4e25-8049-e38252bf7e19 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77862025-02-28T11:22:33.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2081 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = baf3c1ab-a7a2-4e25-8049-e38252bf7e19 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77872025-02-28T11:22:34.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 76bd520a-d971-451f-a922-cb840fa36221 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77882025-02-28T11:22:34.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 76bd520a-d971-451f-a922-cb840fa36221 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77892025-02-28T11:22:34.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 76bd520a-d971-451f-a922-cb840fa36221 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
77902025-02-28T11:22:34.596ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
77912025-02-28T11:22:34.596ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
77922025-02-28T11:22:34.596ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
77932025-02-28T11:22:34.596ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77942025-02-28T11:22:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77952025-02-28T11:22:34.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77962025-02-28T11:22:34.598ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
77972025-02-28T11:22:34.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1923, tv_nsec: 148291016 } })
77982025-02-28T11:22:34.599ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1155
77992025-02-28T11:22:34.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1923, tv_nsec: 148739106 } })
78002025-02-28T11:22:34.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1155
78012025-02-28T11:22:34.601ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.775341ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78022025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
78032025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
78042025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78052025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78062025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
78072025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
78082025-02-28T11:22:34.602ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78092025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78102025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
78112025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78122025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78132025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
78142025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
78152025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78162025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78172025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78182025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
78192025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78202025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
78212025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78222025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
78232025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78242025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
78252025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
78262025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78272025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78282025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
78292025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78302025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 28 reason = Timeout
78312025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
78322025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
78332025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78342025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
78352025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78362025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78372025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78382025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78392025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78402025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78412025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78422025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78432025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78442025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78452025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78462025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78472025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78482025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78492025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78502025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
78512025-02-28T11:22:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78522025-02-28T11:22:34.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78532025-02-28T11:22:34.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78542025-02-28T11:22:34.604ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78552025-02-28T11:22:34.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78562025-02-28T11:22:34.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78572025-02-28T11:22:34.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
78582025-02-28T11:22:34.607ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78592025-02-28T11:22:34.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78602025-02-28T11:22:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
78612025-02-28T11:22:34.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78622025-02-28T11:22:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78632025-02-28T11:22:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
78642025-02-28T11:22:34.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78652025-02-28T11:22:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78662025-02-28T11:22:34.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78672025-02-28T11:22:34.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78682025-02-28T11:22:34.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78692025-02-28T11:22:34.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78702025-02-28T11:22:34.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78712025-02-28T11:22:34.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.426329ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
78722025-02-28T11:22:34.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78732025-02-28T11:22:34.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78742025-02-28T11:22:34.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78752025-02-28T11:22:34.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78762025-02-28T11:22:34.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78772025-02-28T11:22:34.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78782025-02-28T11:22:34.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78792025-02-28T11:22:34.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78802025-02-28T11:22:34.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78812025-02-28T11:22:34.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.926518ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
78822025-02-28T11:22:34.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78832025-02-28T11:22:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78842025-02-28T11:22:34.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78852025-02-28T11:22:34.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-586e5b1c-fe84-4966-a99c-108aa56b2c5f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1923, tv_nsec: 167384865 } })
78862025-02-28T11:22:34.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78872025-02-28T11:22:34.619ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1155 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
78882025-02-28T11:22:34.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78892025-02-28T11:22:34.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
78902025-02-28T11:22:34.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78912025-02-28T11:22:34.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78922025-02-28T11:22:34.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78932025-02-28T11:22:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78942025-02-28T11:22:34.626ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78952025-02-28T11:22:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78962025-02-28T11:22:34.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78972025-02-28T11:22:34.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78982025-02-28T11:22:34.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78992025-02-28T11:22:34.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79002025-02-28T11:22:34.640ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
79012025-02-28T11:22:34.640ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.600856ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
79022025-02-28T11:22:34.644ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79032025-02-28T11:22:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79042025-02-28T11:22:34.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79052025-02-28T11:22:34.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79062025-02-28T11:22:34.656ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79072025-02-28T11:22:34.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79082025-02-28T11:22:34.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79092025-02-28T11:22:34.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79102025-02-28T11:22:34.662ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79112025-02-28T11:22:34.662ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79122025-02-28T11:22:34.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79132025-02-28T11:22:34.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79142025-02-28T11:22:34.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79152025-02-28T11:22:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79162025-02-28T11:22:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79172025-02-28T11:22:34.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79182025-02-28T11:22:34.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79192025-02-28T11:22:34.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79202025-02-28T11:22:34.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79212025-02-28T11:22:34.666ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79222025-02-28T11:22:34.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79232025-02-28T11:22:34.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 586e5b1c-fe84-4966-a99c-108aa56b2c5f, lookup_type: ById(586e5b1c-fe84-4966-a99c-108aa56b2c5f) } result = Ok(())
79242025-02-28T11:22:34.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79252025-02-28T11:22:34.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79262025-02-28T11:22:34.670ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79272025-02-28T11:22:34.671ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.61267ms iteration = 28 status = 0
79282025-02-28T11:22:34.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
79292025-02-28T11:22:34.672ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79302025-02-28T11:22:34.672ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.574451ms iteration = 28 status = {"errors":[],"requests_created_ok":[]}
79312025-02-28T11:22:34.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79322025-02-28T11:22:34.675ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79332025-02-28T11:22:34.676ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79342025-02-28T11:22:34.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79352025-02-28T11:22:34.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79362025-02-28T11:22:34.679ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79372025-02-28T11:22:34.679ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.369787ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
79382025-02-28T11:22:34.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.917719ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79392025-02-28T11:22:34.692ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
79402025-02-28T11:22:34.692ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79412025-02-28T11:22:34.693ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ab4861f-2b08-411e-a95a-d6cda6375b80", "content-length": "26", "date": "Fri, 28 Feb 2025 11:22:33 GMT"} })
79422025-02-28T11:22:34.693ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79432025-02-28T11:22:34.694ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79442025-02-28T11:22:34.694ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 92.508291ms iteration = 31 status = {"physical_disks_added":0}
79452025-02-28T11:22:34.694ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1163 zone_address = fd00:1122:3344:101::2
79462025-02-28T11:22:34.694ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79472025-02-28T11:22:34.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.783667ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
79482025-02-28T11:22:34.695ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77f312ba-b86b-4d71-92e2-5222fa1e4d3e", "content-length": "26", "date": "Fri, 28 Feb 2025 11:22:33 GMT"} })
79492025-02-28T11:22:34.695ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1168 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79502025-02-28T11:22:34.696ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79512025-02-28T11:22:34.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.020092ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79522025-02-28T11:22:34.703ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79532025-02-28T11:22:34.703ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
79542025-02-28T11:22:34.703ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79552025-02-28T11:22:34.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79562025-02-28T11:22:34.706ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
79572025-02-28T11:22:34.706ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 104.293324ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
79582025-02-28T11:22:34.707ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.831426ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79592025-02-28T11:22:34.721ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1163 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af zone_address = fd00:1122:3344:101::2
79602025-02-28T11:22:34.721ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79612025-02-28T11:22:34.721ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "24bfbb66-94e7-499e-81b7-5d443761d081", "content-length": "26", "date": "Fri, 28 Feb 2025 11:22:33 GMT"} })
79622025-02-28T11:22:34.721ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1168 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79632025-02-28T11:22:34.723ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1200 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
79642025-02-28T11:22:34.740ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79652025-02-28T11:22:34.740ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79662025-02-28T11:22:34.740ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 138.781503ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79672025-02-28T11:22:34.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79682025-02-28T11:22:34.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79692025-02-28T11:22:34.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79702025-02-28T11:22:34.766ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79712025-02-28T11:22:34.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79722025-02-28T11:22:34.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79732025-02-28T11:22:34.872ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
79742025-02-28T11:22:34.872ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79752025-02-28T11:22:34.875ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4682f3f0-b119-46a7-8a1c-b75f3e6c11d5", "content-length": "372", "date": "Fri, 28 Feb 2025 11:22:34 GMT"} })
79762025-02-28T11:22:34.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79772025-02-28T11:22:34.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79782025-02-28T11:22:34.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79792025-02-28T11:22:34.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79802025-02-28T11:22:34.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79812025-02-28T11:22:34.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79822025-02-28T11:22:34.917ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
79832025-02-28T11:22:34.917ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "29160a8d-693e-4e3c-adcb-b7ad8b1d99ae", "content-length": "2", "date": "Fri, 28 Feb 2025 11:22:34 GMT"} })
79842025-02-28T11:22:34.917ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
79852025-02-28T11:22:34.917ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
79862025-02-28T11:22:34.918ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1fabb589-908e-4164-9b4b-02786e8abbf1", "date": "Fri, 28 Feb 2025 11:22:34 GMT"} })
79872025-02-28T11:22:34.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79882025-02-28T11:22:34.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79892025-02-28T11:22:34.920ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79902025-02-28T11:22:34.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79912025-02-28T11:22:34.920ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 324.087021ms iteration = 28 status = {}
79922025-02-28T11:22:34.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79932025-02-28T11:22:34.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79942025-02-28T11:22:34.922ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 326.055943ms iteration = 28 status = null
79952025-02-28T11:22:34.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79962025-02-28T11:22:34.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79972025-02-28T11:22:34.928ZINFOnexus (BackgroundTasks): VPC route manager sled 586e5b1c-fe84-4966-a99c-108aa56b2c5f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
79982025-02-28T11:22:34.928ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79992025-02-28T11:22:34.928ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0100178d-5e27-4fab-8637-feab23bd0e6f", "date": "Fri, 28 Feb 2025 11:22:34 GMT"} })
80002025-02-28T11:22:34.929ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 327.889222ms iteration = 29 status = {}
80012025-02-28T11:22:34.953ZDEBGnexus (BackgroundTasks): client request SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80022025-02-28T11:22:34.953ZDEBGnexus (BackgroundTasks): client response SledAgent = 586e5b1c-fe84-4966-a99c-108aa56b2c5f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fb4f942-42a9-406d-8a36-260cd7a86c33", "content-length": "691", "date": "Fri, 28 Feb 2025 11:22:34 GMT"} })
80032025-02-28T11:22:34.953ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
80042025-02-28T11:22:34.953ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
80052025-02-28T11:22:34.953ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
80062025-02-28T11:22:34.954ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 352.407658ms iteration = 29 status = {}
80072025-02-28T11:22:34.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80082025-02-28T11:22:34.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80092025-02-28T11:22:34.969ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c87773d1-4b14-4209-814b-f4d5df941b92, rack_id: 3639df61-b683-4f88-93e4-a3de5b0778af, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7) } rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
80102025-02-28T11:22:34.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80112025-02-28T11:22:34.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80122025-02-28T11:22:34.976ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80132025-02-28T11:22:34.976ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "743c25c8-47c5-4056-adb7-26f91f0998d5", "content-length": "134", "date": "Fri, 28 Feb 2025 11:22:34 GMT"} })
80142025-02-28T11:22:34.976ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80152025-02-28T11:22:34.976ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 35bd0e33-ced4-4eeb-b9ed-a5430bc8b0c7
80162025-02-28T11:22:34.976ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80172025-02-28T11:22:34.976ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80182025-02-28T11:22:34.976ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80192025-02-28T11:22:34.976ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80202025-02-28T11:22:34.976ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80212025-02-28T11:22:34.976ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80222025-02-28T11:22:34.977ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80232025-02-28T11:22:34.977ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80242025-02-28T11:22:34.977ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af
80252025-02-28T11:22:34.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80262025-02-28T11:22:34.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80272025-02-28T11:22:34.979ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
80282025-02-28T11:22:34.979ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "da7d41d3-1730-4310-95a0-e0a0ca92c168", "content-length": "2", "date": "Fri, 28 Feb 2025 11:22:34 GMT"} })
80292025-02-28T11:22:34.979ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
80302025-02-28T11:22:34.979ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aca92ba-0942-4606-8828-5c60ccf12685", "content-length": "52", "date": "Fri, 28 Feb 2025 11:22:34 GMT"} })
80312025-02-28T11:22:34.979ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch_location = Switch0
80322025-02-28T11:22:34.979ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
80332025-02-28T11:22:35.074ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e6dbe4a8-2556-4430-a11b-99d47f0971a9", "date": "Fri, 28 Feb 2025 11:22:34 GMT"} })
80342025-02-28T11:22:35.074ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af switch = Switch0
80352025-02-28T11:22:35.074ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80362025-02-28T11:22:35.074ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3639df61-b683-4f88-93e4-a3de5b0778af result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fc1fb0e-942d-4261-9ce7-6659a53794b3", "content-length": "682", "date": "Fri, 28 Feb 2025 11:22:34 GMT"} })
80372025-02-28T11:22:35.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80382025-02-28T11:22:35.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80392025-02-28T11:22:35.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80402025-02-28T11:22:35.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80412025-02-28T11:22:35.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80422025-02-28T11:22:35.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80432025-02-28T11:22:35.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80442025-02-28T11:22:35.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80452025-02-28T11:22:35.091ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 489.412481ms iteration = 28 status = {}
80462025-02-28T11:22:35.371ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
80472025-02-28T11:22:35.371ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
80482025-02-28T11:22:35.402ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
80492025-02-28T11:22:35.402ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:33443
80502025-02-28T11:22:35.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:33443 req_id = 9a244685-d075-4673-94f1-de84c29a1cf0 roles = RoleSet { roles: {} } uri = /metrics/producers
80512025-02-28T11:22:35.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:33443 req_id = 9a244685-d075-4673-94f1-de84c29a1cf0 resource = Database result = Ok(()) uri = /metrics/producers
80522025-02-28T11:22:35.444ZINFOnexus: assigned collector to new producer collector_id = 59e12d21-f0a8-4840-9b1a-87533ec59eae file = nexus/src/app/oximeter.rs:76 producer_id = a49a6ffa-af87-4978-97cd-b29e51ec9497
80532025-02-28T11:22:35.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41892 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:33443 req_id = 9a244685-d075-4673-94f1-de84c29a1cf0 response_code = 201 uri = /metrics/producers
80542025-02-28T11:22:35.444ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9a244685-d075-4673-94f1-de84c29a1cf0", "content-length": "41", "date": "Fri, 28 Feb 2025 11:22:34 GMT"} })
80552025-02-28T11:22:35.445ZDEBGnexus (producer-registration-task): registered with nexus successfully
80562025-02-28T11:22:35.445ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
80572025-02-28T11:22:35.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d7074b3f-0376-4ca5-bcd7-ecc80dc03006 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80582025-02-28T11:22:35.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d7074b3f-0376-4ca5-bcd7-ecc80dc03006 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80592025-02-28T11:22:35.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d7074b3f-0376-4ca5-bcd7-ecc80dc03006 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80602025-02-28T11:22:36.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ddb8dd71-66d6-4c55-90d2-027b905be9c2 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80612025-02-28T11:22:36.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ddb8dd71-66d6-4c55-90d2-027b905be9c2 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80622025-02-28T11:22:36.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = ddb8dd71-66d6-4c55-90d2-027b905be9c2 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80632025-02-28T11:22:37.085ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 584 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = b8f4aa0e-20de-41d9-aebf-37534fcaa1ff response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
80642025-02-28T11:22:37.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d8d0f60b-b6c0-4e86-8268-a9241f8ef338 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80652025-02-28T11:22:37.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d8d0f60b-b6c0-4e86-8268-a9241f8ef338 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80662025-02-28T11:22:37.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1843 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = d8d0f60b-b6c0-4e86-8268-a9241f8ef338 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80672025-02-28T11:22:38.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = faf6dd98-2058-4e9d-b6f2-e3842441565e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80682025-02-28T11:22:38.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = faf6dd98-2058-4e9d-b6f2-e3842441565e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80692025-02-28T11:22:38.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = faf6dd98-2058-4e9d-b6f2-e3842441565e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80702025-02-28T11:22:39.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a3037507-33a0-4146-8343-68747076e38e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80712025-02-28T11:22:39.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a3037507-33a0-4146-8343-68747076e38e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80722025-02-28T11:22:39.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a3037507-33a0-4146-8343-68747076e38e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80732025-02-28T11:22:40.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1dd2b508-a58c-4a4a-b55d-da3b6051115e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80742025-02-28T11:22:40.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1dd2b508-a58c-4a4a-b55d-da3b6051115e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80752025-02-28T11:22:40.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 1dd2b508-a58c-4a4a-b55d-da3b6051115e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80762025-02-28T11:22:41.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 81c9e010-eb1f-47e2-ab67-48042a88f976 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80772025-02-28T11:22:41.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 81c9e010-eb1f-47e2-ab67-48042a88f976 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80782025-02-28T11:22:41.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 81c9e010-eb1f-47e2-ab67-48042a88f976 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80792025-02-28T11:22:42.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fa76d91f-33b7-4744-b157-eebe5ed48c9f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80802025-02-28T11:22:42.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fa76d91f-33b7-4744-b157-eebe5ed48c9f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80812025-02-28T11:22:42.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = fa76d91f-33b7-4744-b157-eebe5ed48c9f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80822025-02-28T11:22:43.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f3dd5d3f-d48b-4072-bae2-f295a3754f9f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80832025-02-28T11:22:43.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f3dd5d3f-d48b-4072-bae2-f295a3754f9f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80842025-02-28T11:22:43.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = f3dd5d3f-d48b-4072-bae2-f295a3754f9f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
80852025-02-28T11:22:44.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
80862025-02-28T11:22:44.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80872025-02-28T11:22:44.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80882025-02-28T11:22:44.601ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
80892025-02-28T11:22:44.601ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80902025-02-28T11:22:44.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80912025-02-28T11:22:44.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80922025-02-28T11:22:44.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80932025-02-28T11:22:44.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80942025-02-28T11:22:44.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80952025-02-28T11:22:44.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80962025-02-28T11:22:44.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80972025-02-28T11:22:44.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80982025-02-28T11:22:44.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80992025-02-28T11:22:44.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81002025-02-28T11:22:44.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
81012025-02-28T11:22:44.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81022025-02-28T11:22:44.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81032025-02-28T11:22:44.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
81042025-02-28T11:22:44.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.739444ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
81052025-02-28T11:22:44.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.554486ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81062025-02-28T11:22:44.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29fea375-e630-4811-92db-8f1c00ad4d08 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81072025-02-28T11:22:44.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29fea375-e630-4811-92db-8f1c00ad4d08 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81082025-02-28T11:22:44.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2149 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 29fea375-e630-4811-92db-8f1c00ad4d08 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81092025-02-28T11:22:45.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 820b2164-9aca-42d4-84d7-4e9a989a430a roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81102025-02-28T11:22:45.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 820b2164-9aca-42d4-84d7-4e9a989a430a resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81112025-02-28T11:22:45.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2512 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 820b2164-9aca-42d4-84d7-4e9a989a430a response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81122025-02-28T11:22:46.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a187a1b-98e1-4cc9-b00e-72f64ef2cf87 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81132025-02-28T11:22:46.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a187a1b-98e1-4cc9-b00e-72f64ef2cf87 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81142025-02-28T11:22:46.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2a187a1b-98e1-4cc9-b00e-72f64ef2cf87 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81152025-02-28T11:22:47.085ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 768 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = e20adb64-2bea-4721-816b-6c554b4bcbac response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
81162025-02-28T11:22:47.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 45211520-533e-427f-898f-cf770f8df6f4 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81172025-02-28T11:22:47.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 45211520-533e-427f-898f-cf770f8df6f4 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81182025-02-28T11:22:47.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2504 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 45211520-533e-427f-898f-cf770f8df6f4 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81192025-02-28T11:22:48.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6e619eed-c3a6-4447-9bc8-d84f9987634f roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81202025-02-28T11:22:48.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6e619eed-c3a6-4447-9bc8-d84f9987634f resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81212025-02-28T11:22:48.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 6e619eed-c3a6-4447-9bc8-d84f9987634f response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81222025-02-28T11:22:49.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 67ca234d-9cb0-47d3-89db-1cd628a55451 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81232025-02-28T11:22:49.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 67ca234d-9cb0-47d3-89db-1cd628a55451 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81242025-02-28T11:22:49.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 67ca234d-9cb0-47d3-89db-1cd628a55451 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81252025-02-28T11:22:50.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a6a3a15d-e7fc-4c18-8047-e0ddf1bfd1c6 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81262025-02-28T11:22:50.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a6a3a15d-e7fc-4c18-8047-e0ddf1bfd1c6 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81272025-02-28T11:22:50.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a6a3a15d-e7fc-4c18-8047-e0ddf1bfd1c6 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81282025-02-28T11:22:51.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8b4a9305-dd31-4351-b64e-a177b5dd40fc roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81292025-02-28T11:22:51.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8b4a9305-dd31-4351-b64e-a177b5dd40fc resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81302025-02-28T11:22:51.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 8b4a9305-dd31-4351-b64e-a177b5dd40fc response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81312025-02-28T11:22:52.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4ba03756-f220-4ab5-8262-d38c2e63cdb7 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81322025-02-28T11:22:52.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4ba03756-f220-4ab5-8262-d38c2e63cdb7 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81332025-02-28T11:22:52.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2580 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4ba03756-f220-4ab5-8262-d38c2e63cdb7 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81342025-02-28T11:22:53.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3de0d325-8643-4bb6-9e14-e74e53987321 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81352025-02-28T11:22:53.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3de0d325-8643-4bb6-9e14-e74e53987321 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81362025-02-28T11:22:53.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 3de0d325-8643-4bb6-9e14-e74e53987321 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81372025-02-28T11:22:54.601ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
81382025-02-28T11:22:54.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81392025-02-28T11:22:54.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81402025-02-28T11:22:54.602ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
81412025-02-28T11:22:54.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81422025-02-28T11:22:54.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81432025-02-28T11:22:54.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81442025-02-28T11:22:54.604ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81452025-02-28T11:22:54.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81462025-02-28T11:22:54.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81472025-02-28T11:22:54.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81482025-02-28T11:22:54.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81492025-02-28T11:22:54.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.70143ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81502025-02-28T11:22:54.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81512025-02-28T11:22:54.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81522025-02-28T11:22:54.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81532025-02-28T11:22:54.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7549b177-a582-4102-91fb-b7e6324fd615, lookup_type: ById(7549b177-a582-4102-91fb-b7e6324fd615) } result = Ok(())
81542025-02-28T11:22:54.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81552025-02-28T11:22:54.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81562025-02-28T11:22:54.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7549b177-a582-4102-91fb-b7e6324fd615 original_time_created = 2025-02-28 11:08:59.083378 UTC target_id = 7549b177-a582-4102-91fb-b7e6324fd615 time_created = 2025-02-28 11:08:59.083378 UTC
81572025-02-28T11:22:54.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.49054ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7549b177-a582-4102-91fb-b7e6324fd615","time_created":"2025-02-28T11:08:59.083378Z"}
81582025-02-28T11:22:54.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e5ed03b8-a7a5-448c-91f5-211677755071 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81592025-02-28T11:22:54.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e5ed03b8-a7a5-448c-91f5-211677755071 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81602025-02-28T11:22:54.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1900 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e5ed03b8-a7a5-448c-91f5-211677755071 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81612025-02-28T11:22:56.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5ceb7c73-d1f5-499a-8d4b-080287492a89 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81622025-02-28T11:22:56.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5ceb7c73-d1f5-499a-8d4b-080287492a89 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81632025-02-28T11:22:56.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 5ceb7c73-d1f5-499a-8d4b-080287492a89 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81642025-02-28T11:22:57.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 65f1dafa-cefb-4f70-b24f-1f61dccc9cf0 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81652025-02-28T11:22:57.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 65f1dafa-cefb-4f70-b24f-1f61dccc9cf0 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81662025-02-28T11:22:57.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 65f1dafa-cefb-4f70-b24f-1f61dccc9cf0 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81672025-02-28T11:22:57.085ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 990 local_addr = [fd00:1122:3344:101::a]:60061 method = GET remote_addr = [fd00:1122:3344:101::d]:37018 req_id = b614ecb9-fa4d-41e0-adff-f4953c1bcada response_code = 200 uri = /a49a6ffa-af87-4978-97cd-b29e51ec9497
81682025-02-28T11:22:58.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7e9a2135-a18f-4576-93f9-1464608a738c roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81692025-02-28T11:22:58.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7e9a2135-a18f-4576-93f9-1464608a738c resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81702025-02-28T11:22:58.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 7e9a2135-a18f-4576-93f9-1464608a738c response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81712025-02-28T11:22:59.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e37b8391-50d6-4b20-9d61-1ffa7cdec017 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81722025-02-28T11:22:59.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e37b8391-50d6-4b20-9d61-1ffa7cdec017 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81732025-02-28T11:22:59.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = e37b8391-50d6-4b20-9d61-1ffa7cdec017 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81742025-02-28T11:23:00.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a30f4523-a7b4-417f-849d-6960bee1994e roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81752025-02-28T11:23:00.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a30f4523-a7b4-417f-849d-6960bee1994e resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81762025-02-28T11:23:00.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = a30f4523-a7b4-417f-849d-6960bee1994e response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81772025-02-28T11:23:01.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4af8739c-86a9-4dc8-b517-2e4a7c30ac69 roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81782025-02-28T11:23:01.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4af8739c-86a9-4dc8-b517-2e4a7c30ac69 resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81792025-02-28T11:23:01.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 4af8739c-86a9-4dc8-b517-2e4a7c30ac69 response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81802025-02-28T11:23:02.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2faf8ea5-5f4e-4401-b524-96256499ca3b roles = RoleSet { roles: {} } uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81812025-02-28T11:23:02.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2faf8ea5-5f4e-4401-b524-96256499ca3b resource = Database result = Ok(()) uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f
81822025-02-28T11:23:02.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:57546 req_id = 2faf8ea5-5f4e-4401-b524-96256499ca3b response_code = 200 uri = /probes/586e5b1c-fe84-4966-a99c-108aa56b2c5f