Max level shown:
12024-01-11T01:00:03.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 3c128cf7-7a65-45b0-87ee-0562f55cfbea roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
22024-01-11T01:00:03.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 3c128cf7-7a65-45b0-87ee-0562f55cfbea resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
32024-01-11T01:00:03.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 4000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 3c128cf7-7a65-45b0-87ee-0562f55cfbea response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
42024-01-11T01:00:03.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 62a86cdd-70f7-4061-a428-9366400edd4b response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
52024-01-11T01:00:13.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = d643b0bb-4894-4a88-af03-129d88126730 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
62024-01-11T01:00:23.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 93fb40f9-2f3a-49c1-8ac7-4017510f424b response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
72024-01-11T01:00:27.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
82024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
92024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
102024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
122024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
132024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
142024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
152024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
162024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
172024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
182024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
192024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {} }
202024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {} }
212024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
222024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
232024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
242024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Database result = Ok(())
252024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Database result = Ok(())
262024-01-11T01:00:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
272024-01-11T01:00:27.992ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
282024-01-11T01:00:27.992ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
292024-01-11T01:00:27.992ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:50
302024-01-11T01:00:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
312024-01-11T01:00:27.992ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
322024-01-11T01:00:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
332024-01-11T01:00:27.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
342024-01-11T01:00:27.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
352024-01-11T01:00:27.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
362024-01-11T01:00:27.993ZDEBGnexus (DpdClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
372024-01-11T01:00:27.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
382024-01-11T01:00:27.994ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6027e13f-6f41-40ee-b28b-f2860fe32ea7", "content-length": "1", "date": "Thu, 11 Jan 2024 01:00:27 GMT"} })
392024-01-11T01:00:27.994ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
402024-01-11T01:00:27.994ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
412024-01-11T01:00:27.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
422024-01-11T01:00:27.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
432024-01-11T01:00:27.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
442024-01-11T01:00:27.996ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:96
452024-01-11T01:00:27.996ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.007217ms iteration = 12
462024-01-11T01:00:27.996ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 4.112939ms iteration = 12
472024-01-11T01:00:27.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Fleet result = Ok(())
482024-01-11T01:00:27.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {} }
492024-01-11T01:00:27.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Database result = Ok(())
502024-01-11T01:00:27.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
512024-01-11T01:00:27.997ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
522024-01-11T01:00:27.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
532024-01-11T01:00:27.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Fleet result = Ok(())
542024-01-11T01:00:27.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {} }
552024-01-11T01:00:27.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Database result = Ok(())
562024-01-11T01:00:27.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
572024-01-11T01:00:27.998ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
582024-01-11T01:00:27.998ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 7.279808ms iteration = 8
592024-01-11T01:00:27.998ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
602024-01-11T01:00:27.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
612024-01-11T01:00:27.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
622024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
632024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
642024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
652024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
662024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
672024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
682024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 8.219969ms iteration = 8
692024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
702024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
712024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
722024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
732024-01-11T01:00:27.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
742024-01-11T01:00:28.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
752024-01-11T01:00:28.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
762024-01-11T01:00:28.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
772024-01-11T01:00:28.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
782024-01-11T01:00:28.002ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
792024-01-11T01:00:28.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
802024-01-11T01:00:28.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
812024-01-11T01:00:28.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
822024-01-11T01:00:28.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
832024-01-11T01:00:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
842024-01-11T01:00:28.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
852024-01-11T01:00:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
862024-01-11T01:00:28.004ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
872024-01-11T01:00:28.004ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f9e01a1e-655a-477b-b0f5-22e3db0586ec dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
882024-01-11T01:00:28.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
892024-01-11T01:00:28.004ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
902024-01-11T01:00:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
912024-01-11T01:00:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
922024-01-11T01:00:28.005ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
932024-01-11T01:00:28.005ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 67120ed0-9222-49a7-9d6f-b2dbd25bde25 dns_zone_name = oxide.test found_so_far = 0 version = 2
942024-01-11T01:00:28.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
952024-01-11T01:00:28.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
962024-01-11T01:00:28.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
972024-01-11T01:00:28.005ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
982024-01-11T01:00:28.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
992024-01-11T01:00:28.007ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1002024-01-11T01:00:28.008ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1012024-01-11T01:00:28.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1022024-01-11T01:00:28.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
1032024-01-11T01:00:28.008ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1042024-01-11T01:00:28.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1052024-01-11T01:00:28.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
1062024-01-11T01:00:28.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1072024-01-11T01:00:28.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1082024-01-11T01:00:28.010ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 67120ed0-9222-49a7-9d6f-b2dbd25bde25 dns_zone_name = oxide.test found_so_far = 1 version = 2
1092024-01-11T01:00:28.010ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
1102024-01-11T01:00:28.010ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-01-11 00:55:59.472363 UTC dns_group = external generation = 2
1112024-01-11T01:00:28.010ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 19.831982ms iteration = 8
1122024-01-11T01:00:28.011ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f9e01a1e-655a-477b-b0f5-22e3db0586ec dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
1132024-01-11T01:00:28.011ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
1142024-01-11T01:00:28.011ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-01-11 00:55:59.078467 UTC dns_group = internal generation = 1
1152024-01-11T01:00:28.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 20.359604ms iteration = 8
1162024-01-11T01:00:28.013ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-01-11T00:55:28.054310Z, time_modified: 2024-01-11T00:55:28.054310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f090710e-c390-43cc-ac73-521c7e579a79, db_silo: Silo { identity: SiloIdentity { id: f090710e-c390-43cc-ac73-521c7e579a79, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-01-11T00:55:59.446411Z, time_modified: 2024-01-11T00:55:59.446411Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "262b888f144019b1d68f6e4aa4b850bc6d171be00b1cf3fe17726b4cf1d4a104" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f090710e-c390-43cc-ac73-521c7e579a79, db_silo: Silo { identity: SiloIdentity { id: f090710e-c390-43cc-ac73-521c7e579a79, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-01-11T00:55:59.446411Z, time_modified: 2024-01-11T00:55:59.446411Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "262b888f144019b1d68f6e4aa4b850bc6d171be00b1cf3fe17726b4cf1d4a104" }] }) }
1172024-01-11T01:00:28.013ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 22.559131ms iteration = 8
1182024-01-11T01:00:28.032ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
1192024-01-11T01:00:28.033ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
1202024-01-11T01:00:28.070ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
1212024-01-11T01:00:28.070ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
1222024-01-11T01:00:28.070ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2a96f5f5-30f4-4768-bc6a-97f0f3abb02d", "date": "Thu, 11 Jan 2024 01:00:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
1232024-01-11T01:00:28.070ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
1242024-01-11T01:00:28.072ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0cd3ae14-3995-4fc1-91e8-14cf44608cd2", "date": "Thu, 11 Jan 2024 01:00:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
1252024-01-11T01:00:28.072ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
1262024-01-11T01:00:28.073ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/dns_propagation.rs:110 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
1272024-01-11T01:00:28.073ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 82.628059ms iteration = 10
1282024-01-11T01:00:28.100ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
1292024-01-11T01:00:28.100ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7f27cc5d-862d-473d-b9d8-51ea05f3a579", "date": "Thu, 11 Jan 2024 01:00:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
1302024-01-11T01:00:28.100ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
1312024-01-11T01:00:28.101ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4c4a8ca8-a959-4fd0-a89e-7a44c4e9ea69", "date": "Thu, 11 Jan 2024 01:00:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
1322024-01-11T01:00:28.101ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
1332024-01-11T01:00:28.102ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "652bb961-1c56-4199-8be0-ab9549a05ea0", "date": "Thu, 11 Jan 2024 01:00:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
1342024-01-11T01:00:28.102ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
1352024-01-11T01:00:28.103ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/dns_propagation.rs:110 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
1362024-01-11T01:00:28.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 112.763795ms iteration = 10
1372024-01-11T01:00:33.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 8e86aa1f-39db-4905-afce-e1ec1bcb2dd5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
1382024-01-11T01:00:33.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 8e86aa1f-39db-4905-afce-e1ec1bcb2dd5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
1392024-01-11T01:00:33.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 3616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 8e86aa1f-39db-4905-afce-e1ec1bcb2dd5 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
1402024-01-11T01:00:33.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 19504331-950f-4d54-8cf9-780851c76f86 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
1412024-01-11T01:00:43.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = f29cfb76-7923-42d5-ae50-56c76296adf1 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
1422024-01-11T01:00:53.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = d42a9327-0b65-43a5-9a29-20196ac1f4b7 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
1432024-01-11T01:00:57.991ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
1442024-01-11T01:00:57.991ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1452024-01-11T01:00:57.991ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
1462024-01-11T01:00:57.991ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:50
1472024-01-11T01:00:57.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1482024-01-11T01:00:57.993ZDEBGnexus (DpdClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1492024-01-11T01:00:57.994ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "836b12b5-dff7-4598-89f3-10fd27fc5727", "content-length": "1", "date": "Thu, 11 Jan 2024 01:00:57 GMT"} })
1502024-01-11T01:00:57.994ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1512024-01-11T01:00:57.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1522024-01-11T01:00:57.995ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:96
1532024-01-11T01:00:57.995ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.64447ms iteration = 13
1542024-01-11T01:00:57.996ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 5.124802ms iteration = 13
1552024-01-11T01:01:03.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 7d9230e7-ecd2-47e3-a38a-43ec35213431 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
1562024-01-11T01:01:03.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 7d9230e7-ecd2-47e3-a38a-43ec35213431 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
1572024-01-11T01:01:03.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 2676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 7d9230e7-ecd2-47e3-a38a-43ec35213431 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
1582024-01-11T01:01:03.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 7b0d443f-4c33-4652-81b2-4a7644e29663 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
1592024-01-11T01:01:13.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 1c177a2d-bc0d-4022-b01a-be00e41a6fb8 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
1602024-01-11T01:01:23.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = fdf9f32c-f8f0-45dc-9642-062a783d647b response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
1612024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
1622024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
1632024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1642024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1652024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
1662024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
1672024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
1682024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1692024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
1702024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {} }
1712024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {} }
1722024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
1732024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1742024-01-11T01:01:27.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1752024-01-11T01:01:27.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Database result = Ok(())
1762024-01-11T01:01:27.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1772024-01-11T01:01:27.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Database result = Ok(())
1782024-01-11T01:01:27.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1792024-01-11T01:01:27.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1802024-01-11T01:01:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1812024-01-11T01:01:27.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1822024-01-11T01:01:27.991ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
1832024-01-11T01:01:27.991ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
1842024-01-11T01:01:27.991ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1852024-01-11T01:01:27.991ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:50
1862024-01-11T01:01:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1872024-01-11T01:01:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1882024-01-11T01:01:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1892024-01-11T01:01:27.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1902024-01-11T01:01:27.993ZDEBGnexus (DpdClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1912024-01-11T01:01:27.994ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f8201f1c-f819-4698-81a5-8258b727aa94", "content-length": "1", "date": "Thu, 11 Jan 2024 01:01:27 GMT"} })
1922024-01-11T01:01:27.994ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1932024-01-11T01:01:27.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1942024-01-11T01:01:27.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1952024-01-11T01:01:27.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1962024-01-11T01:01:27.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1972024-01-11T01:01:27.994ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:96
1982024-01-11T01:01:27.994ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.058787ms iteration = 14
1992024-01-11T01:01:27.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2002024-01-11T01:01:27.995ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 3.780862ms iteration = 14
2012024-01-11T01:01:27.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Fleet result = Ok(())
2022024-01-11T01:01:27.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {} }
2032024-01-11T01:01:27.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Database result = Ok(())
2042024-01-11T01:01:27.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Fleet result = Ok(())
2052024-01-11T01:01:27.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {} }
2062024-01-11T01:01:27.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2072024-01-11T01:01:27.997ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2082024-01-11T01:01:27.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Database result = Ok(())
2092024-01-11T01:01:27.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2102024-01-11T01:01:27.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2112024-01-11T01:01:27.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2122024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2132024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2142024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2152024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2162024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2172024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2182024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2192024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2202024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2212024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
2222024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 8.600257ms iteration = 9
2232024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2242024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
2252024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 8.887213ms iteration = 9
2262024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2272024-01-11T01:01:27.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2282024-01-11T01:01:28.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2292024-01-11T01:01:28.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2302024-01-11T01:01:28.000ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2312024-01-11T01:01:28.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2322024-01-11T01:01:28.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2332024-01-11T01:01:28.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2342024-01-11T01:01:28.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2352024-01-11T01:01:28.003ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2362024-01-11T01:01:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2372024-01-11T01:01:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2382024-01-11T01:01:28.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2392024-01-11T01:01:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2402024-01-11T01:01:28.005ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2412024-01-11T01:01:28.005ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
2422024-01-11T01:01:28.005ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f9e01a1e-655a-477b-b0f5-22e3db0586ec dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
2432024-01-11T01:01:28.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2442024-01-11T01:01:28.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2452024-01-11T01:01:28.005ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
2462024-01-11T01:01:28.005ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 67120ed0-9222-49a7-9d6f-b2dbd25bde25 dns_zone_name = oxide.test found_so_far = 0 version = 2
2472024-01-11T01:01:28.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2482024-01-11T01:01:28.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2492024-01-11T01:01:28.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2502024-01-11T01:01:28.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2512024-01-11T01:01:28.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2522024-01-11T01:01:28.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2532024-01-11T01:01:28.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2542024-01-11T01:01:28.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2552024-01-11T01:01:28.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2562024-01-11T01:01:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2572024-01-11T01:01:28.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2582024-01-11T01:01:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2592024-01-11T01:01:28.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2602024-01-11T01:01:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2612024-01-11T01:01:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2622024-01-11T01:01:28.012ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 67120ed0-9222-49a7-9d6f-b2dbd25bde25 dns_zone_name = oxide.test found_so_far = 1 version = 2
2632024-01-11T01:01:28.012ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
2642024-01-11T01:01:28.012ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-01-11 00:55:59.472363 UTC dns_group = external generation = 2
2652024-01-11T01:01:28.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 21.511459ms iteration = 9
2662024-01-11T01:01:28.012ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f9e01a1e-655a-477b-b0f5-22e3db0586ec dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
2672024-01-11T01:01:28.012ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
2682024-01-11T01:01:28.012ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-01-11 00:55:59.078467 UTC dns_group = internal generation = 1
2692024-01-11T01:01:28.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 21.784044ms iteration = 9
2702024-01-11T01:01:28.014ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-01-11T00:55:28.054310Z, time_modified: 2024-01-11T00:55:28.054310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f090710e-c390-43cc-ac73-521c7e579a79, db_silo: Silo { identity: SiloIdentity { id: f090710e-c390-43cc-ac73-521c7e579a79, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-01-11T00:55:59.446411Z, time_modified: 2024-01-11T00:55:59.446411Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "262b888f144019b1d68f6e4aa4b850bc6d171be00b1cf3fe17726b4cf1d4a104" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f090710e-c390-43cc-ac73-521c7e579a79, db_silo: Silo { identity: SiloIdentity { id: f090710e-c390-43cc-ac73-521c7e579a79, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-01-11T00:55:59.446411Z, time_modified: 2024-01-11T00:55:59.446411Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "262b888f144019b1d68f6e4aa4b850bc6d171be00b1cf3fe17726b4cf1d4a104" }] }) }
2712024-01-11T01:01:28.014ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 23.88311ms iteration = 9
2722024-01-11T01:01:28.054ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
2732024-01-11T01:01:28.054ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
2742024-01-11T01:01:28.117ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
2752024-01-11T01:01:28.118ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dc2aef61-13f7-4bb3-bb6a-cbc2b77b62d9", "date": "Thu, 11 Jan 2024 01:01:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2762024-01-11T01:01:28.118ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2772024-01-11T01:01:28.119ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
2782024-01-11T01:01:28.119ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "80b33c33-a9e1-4f50-83e6-1fe1a8af245f", "date": "Thu, 11 Jan 2024 01:01:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2792024-01-11T01:01:28.119ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2802024-01-11T01:01:28.121ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/dns_propagation.rs:110 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
2812024-01-11T01:01:28.121ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 131.133815ms iteration = 11
2822024-01-11T01:01:28.149ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
2832024-01-11T01:01:28.150ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "51053548-70cf-45b9-ba57-90d2c018e0b3", "date": "Thu, 11 Jan 2024 01:01:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2842024-01-11T01:01:28.150ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2852024-01-11T01:01:28.150ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "adac9b7b-1f2d-4f4c-b69d-4e1a656f8019", "date": "Thu, 11 Jan 2024 01:01:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2862024-01-11T01:01:28.150ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2872024-01-11T01:01:28.152ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "23627c41-42e0-4b35-ac4b-9c47ac56d93f", "date": "Thu, 11 Jan 2024 01:01:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2882024-01-11T01:01:28.152ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2892024-01-11T01:01:28.154ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/dns_propagation.rs:110 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2902024-01-11T01:01:28.154ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 164.194115ms iteration = 11
2912024-01-11T01:01:33.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 6b1c0588-ad28-4ff9-998f-603b9c57bc38 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
2922024-01-11T01:01:33.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 6b1c0588-ad28-4ff9-998f-603b9c57bc38 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
2932024-01-11T01:01:33.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 6b1c0588-ad28-4ff9-998f-603b9c57bc38 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
2942024-01-11T01:01:33.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 52a84f48-70cd-420a-ae2e-1591a7a04bc6 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
2952024-01-11T01:01:43.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 4db7c32a-d866-45a3-a15d-aac42e7ad9de response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
2962024-01-11T01:01:53.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 0c15fd99-47b7-4abe-884e-e6e2123c0017 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
2972024-01-11T01:01:57.991ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
2982024-01-11T01:01:57.991ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2992024-01-11T01:01:57.991ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
3002024-01-11T01:01:57.991ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:50
3012024-01-11T01:01:57.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3022024-01-11T01:01:57.993ZDEBGnexus (DpdClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3032024-01-11T01:01:57.993ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bad61d8b-f336-4c22-8456-1fe9a7dfb043", "content-length": "1", "date": "Thu, 11 Jan 2024 01:01:57 GMT"} })
3042024-01-11T01:01:57.993ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3052024-01-11T01:01:57.994ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:96
3062024-01-11T01:01:57.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3072024-01-11T01:01:57.994ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.466524ms iteration = 15
3082024-01-11T01:01:57.995ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 3.695601ms iteration = 15
3092024-01-11T01:02:03.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = fb11353a-e920-4026-9dce-bc7e1e6cecf2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
3102024-01-11T01:02:03.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = fb11353a-e920-4026-9dce-bc7e1e6cecf2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
3112024-01-11T01:02:03.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = fb11353a-e920-4026-9dce-bc7e1e6cecf2 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
3122024-01-11T01:02:03.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = f7e6f506-5026-46e0-9eb0-5a9c72bbf9a8 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
3132024-01-11T01:02:04.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 2d7cc169-972d-4a8e-af44-22a77c53bb76 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
3142024-01-11T01:02:04.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 2d7cc169-972d-4a8e-af44-22a77c53bb76 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
3152024-01-11T01:02:04.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 4116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 2d7cc169-972d-4a8e-af44-22a77c53bb76 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
3162024-01-11T01:02:04.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 23341f92-78b7-4c75-a426-2ab0a111d247 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/2?limit=100
3172024-01-11T01:02:04.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 23341f92-78b7-4c75-a426-2ab0a111d247 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/2?limit=100
3182024-01-11T01:02:04.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 3065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 23341f92-78b7-4c75-a426-2ab0a111d247 response_code = 200 uri = /nat/ipv4/changeset/2?limit=100
3192024-01-11T01:02:11.601ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:59709
3202024-01-11T01:02:11.603ZINFOnexus: received new runtime state from sled agent file = nexus/src/app/instance.rs:1425 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 instance_state = InstanceRuntimeState { propolis_id: Some(b1f6f73e-258c-4dac-bcae-7d0dcfd824b5), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-01-11T01:02:03.677294349Z } propolis_id = b1f6f73e-258c-4dac-bcae-7d0dcfd824b5 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-01-11T01:02:11.598282634Z }
3212024-01-11T01:02:11.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3222024-01-11T01:02:11.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3232024-01-11T01:02:11.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3242024-01-11T01:02:11.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3252024-01-11T01:02:11.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3262024-01-11T01:02:11.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3272024-01-11T01:02:11.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3282024-01-11T01:02:11.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3292024-01-11T01:02:11.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3302024-01-11T01:02:11.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3312024-01-11T01:02:11.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3322024-01-11T01:02:11.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3332024-01-11T01:02:11.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3342024-01-11T01:02:11.626ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f090710e-c390-43cc-ac73-521c7e579a79, lookup_type: ById(f090710e-c390-43cc-ac73-521c7e579a79) }, key: a927764e-678c-443a-bc57-a1e8126ab062, lookup_type: ById(a927764e-678c-443a-bc57-a1e8126ab062) }, key: cbd9c8cf-b9a0-4e87-b36d-37053aea5882, lookup_type: ById(cbd9c8cf-b9a0-4e87-b36d-37053aea5882) } result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3352024-01-11T01:02:11.626ZDEBGnexus: instance state generation already advanced, won't touch network config instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3362024-01-11T01:02:11.633ZINFOnexus: instance and vmm updated by sled agent file = nexus/src/app/instance.rs:1561 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 instance_updated = false propolis_id = b1f6f73e-258c-4dac-bcae-7d0dcfd824b5 vmm_updated = true
3372024-01-11T01:02:11.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 32478 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = c90de3dd-1f25-481b-a500-f47d1b22394d response_code = 204 uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3382024-01-11T01:02:11.634ZINFOnexus: received new runtime state from sled agent file = nexus/src/app/instance.rs:1425 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 instance_state = InstanceRuntimeState { propolis_id: Some(b1f6f73e-258c-4dac-bcae-7d0dcfd824b5), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-01-11T01:02:03.677294349Z } propolis_id = b1f6f73e-258c-4dac-bcae-7d0dcfd824b5 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-01-11T01:02:11.634040742Z }
3392024-01-11T01:02:11.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3402024-01-11T01:02:11.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3412024-01-11T01:02:11.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3422024-01-11T01:02:11.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3432024-01-11T01:02:11.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3442024-01-11T01:02:11.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3452024-01-11T01:02:11.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3462024-01-11T01:02:11.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3472024-01-11T01:02:11.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3482024-01-11T01:02:11.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3492024-01-11T01:02:11.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3502024-01-11T01:02:11.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3512024-01-11T01:02:11.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3522024-01-11T01:02:11.646ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f090710e-c390-43cc-ac73-521c7e579a79, lookup_type: ById(f090710e-c390-43cc-ac73-521c7e579a79) }, key: a927764e-678c-443a-bc57-a1e8126ab062, lookup_type: ById(a927764e-678c-443a-bc57-a1e8126ab062) }, key: cbd9c8cf-b9a0-4e87-b36d-37053aea5882, lookup_type: ById(cbd9c8cf-b9a0-4e87-b36d-37053aea5882) } result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3532024-01-11T01:02:11.646ZDEBGnexus: instance state generation already advanced, won't touch network config instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3542024-01-11T01:02:11.653ZINFOnexus: instance and vmm updated by sled agent file = nexus/src/app/instance.rs:1561 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 instance_updated = false propolis_id = b1f6f73e-258c-4dac-bcae-7d0dcfd824b5 vmm_updated = true
3552024-01-11T01:02:11.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 19329 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 9e37d62d-c695-4acd-a7f3-85b4f042d7ad response_code = 204 uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
3562024-01-11T01:02:13.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = b44338bd-0149-495d-bf52-3125d8d65b38 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
3572024-01-11T01:02:23.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 4a9983a3-372a-456a-866c-e547409afd8e response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
3582024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
3592024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
3602024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3612024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3622024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
3632024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
3642024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3652024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
3662024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
3672024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3682024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
3692024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
3702024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {} }
3712024-01-11T01:02:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {} }
3722024-01-11T01:02:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3732024-01-11T01:02:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3742024-01-11T01:02:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3752024-01-11T01:02:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Database result = Ok(())
3762024-01-11T01:02:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Database result = Ok(())
3772024-01-11T01:02:27.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3782024-01-11T01:02:27.992ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
3792024-01-11T01:02:27.992ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
3802024-01-11T01:02:27.992ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:50
3812024-01-11T01:02:27.992ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3822024-01-11T01:02:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3832024-01-11T01:02:27.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3842024-01-11T01:02:27.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3852024-01-11T01:02:27.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3862024-01-11T01:02:27.998ZDEBGnexus (DpdClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3872024-01-11T01:02:27.998ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d2ea17fe-6761-49e2-a8b3-e5c4a04b544b", "content-length": "1", "date": "Thu, 11 Jan 2024 01:02:27 GMT"} })
3882024-01-11T01:02:27.998ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3892024-01-11T01:02:27.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3902024-01-11T01:02:27.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3912024-01-11T01:02:27.999ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3922024-01-11T01:02:27.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3932024-01-11T01:02:27.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3942024-01-11T01:02:27.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3952024-01-11T01:02:28.001ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 8.790122ms iteration = 16
3962024-01-11T01:02:28.001ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:96
3972024-01-11T01:02:28.001ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.821083ms iteration = 16
3982024-01-11T01:02:28.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Fleet result = Ok(())
3992024-01-11T01:02:28.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {} }
4002024-01-11T01:02:28.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Database result = Ok(())
4012024-01-11T01:02:28.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4022024-01-11T01:02:28.003ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4032024-01-11T01:02:28.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Fleet result = Ok(())
4042024-01-11T01:02:28.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {} }
4052024-01-11T01:02:28.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4062024-01-11T01:02:28.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Database result = Ok(())
4072024-01-11T01:02:28.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4082024-01-11T01:02:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4092024-01-11T01:02:28.004ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
4102024-01-11T01:02:28.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 12.464921ms iteration = 10
4112024-01-11T01:02:28.004ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
4122024-01-11T01:02:28.004ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
4132024-01-11T01:02:28.004ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
4142024-01-11T01:02:28.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4152024-01-11T01:02:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4162024-01-11T01:02:28.005ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
4172024-01-11T01:02:28.005ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
4182024-01-11T01:02:28.005ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
4192024-01-11T01:02:28.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4202024-01-11T01:02:28.005ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4212024-01-11T01:02:28.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4222024-01-11T01:02:28.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4232024-01-11T01:02:28.005ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
4242024-01-11T01:02:28.005ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 14.069817ms iteration = 10
4252024-01-11T01:02:28.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4262024-01-11T01:02:28.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4272024-01-11T01:02:28.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4282024-01-11T01:02:28.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4292024-01-11T01:02:28.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4302024-01-11T01:02:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4312024-01-11T01:02:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4322024-01-11T01:02:28.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4332024-01-11T01:02:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4342024-01-11T01:02:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
4352024-01-11T01:02:28.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4362024-01-11T01:02:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4372024-01-11T01:02:28.011ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
4382024-01-11T01:02:28.011ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f9e01a1e-655a-477b-b0f5-22e3db0586ec dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
4392024-01-11T01:02:28.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4402024-01-11T01:02:28.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4412024-01-11T01:02:28.011ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
4422024-01-11T01:02:28.011ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 67120ed0-9222-49a7-9d6f-b2dbd25bde25 dns_zone_name = oxide.test found_so_far = 0 version = 2
4432024-01-11T01:02:28.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4442024-01-11T01:02:28.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4452024-01-11T01:02:28.012ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4462024-01-11T01:02:28.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4472024-01-11T01:02:28.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4482024-01-11T01:02:28.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4492024-01-11T01:02:28.013ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4502024-01-11T01:02:28.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4512024-01-11T01:02:28.015ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4522024-01-11T01:02:28.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4532024-01-11T01:02:28.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4542024-01-11T01:02:28.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4552024-01-11T01:02:28.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4562024-01-11T01:02:28.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4572024-01-11T01:02:28.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4582024-01-11T01:02:28.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4592024-01-11T01:02:28.018ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 67120ed0-9222-49a7-9d6f-b2dbd25bde25 dns_zone_name = oxide.test found_so_far = 1 version = 2
4602024-01-11T01:02:28.018ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4612024-01-11T01:02:28.018ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-01-11 00:55:59.472363 UTC dns_group = external generation = 2
4622024-01-11T01:02:28.018ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 26.695021ms iteration = 10
4632024-01-11T01:02:28.018ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f9e01a1e-655a-477b-b0f5-22e3db0586ec dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
4642024-01-11T01:02:28.018ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4652024-01-11T01:02:28.018ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-01-11 00:55:59.078467 UTC dns_group = internal generation = 1
4662024-01-11T01:02:28.018ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 26.743612ms iteration = 10
4672024-01-11T01:02:28.021ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-01-11T00:55:28.054310Z, time_modified: 2024-01-11T00:55:28.054310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f090710e-c390-43cc-ac73-521c7e579a79, db_silo: Silo { identity: SiloIdentity { id: f090710e-c390-43cc-ac73-521c7e579a79, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-01-11T00:55:59.446411Z, time_modified: 2024-01-11T00:55:59.446411Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "262b888f144019b1d68f6e4aa4b850bc6d171be00b1cf3fe17726b4cf1d4a104" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f090710e-c390-43cc-ac73-521c7e579a79, db_silo: Silo { identity: SiloIdentity { id: f090710e-c390-43cc-ac73-521c7e579a79, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-01-11T00:55:59.446411Z, time_modified: 2024-01-11T00:55:59.446411Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "262b888f144019b1d68f6e4aa4b850bc6d171be00b1cf3fe17726b4cf1d4a104" }] }) } file = nexus/src/app/background/external_endpoints.rs:105
4682024-01-11T01:02:28.021ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 29.894701ms iteration = 10
4692024-01-11T01:02:28.054ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4702024-01-11T01:02:28.054ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4712024-01-11T01:02:28.110ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4722024-01-11T01:02:28.111ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a2e50b97-a184-450b-9130-85862ccd07b8", "date": "Thu, 11 Jan 2024 01:02:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4732024-01-11T01:02:28.111ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4742024-01-11T01:02:28.111ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4752024-01-11T01:02:28.113ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fa75d552-33ee-4070-88d3-df18398a875f", "date": "Thu, 11 Jan 2024 01:02:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4762024-01-11T01:02:28.113ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4772024-01-11T01:02:28.114ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/dns_propagation.rs:110 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4782024-01-11T01:02:28.114ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 122.909205ms iteration = 12
4792024-01-11T01:02:28.142ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4802024-01-11T01:02:28.142ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bd252103-fbea-4d72-92fd-d489da5e2974", "date": "Thu, 11 Jan 2024 01:02:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4812024-01-11T01:02:28.142ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4822024-01-11T01:02:28.144ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "81f572f3-3a3e-4563-8eed-a8f64281b034", "date": "Thu, 11 Jan 2024 01:02:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4832024-01-11T01:02:28.144ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4842024-01-11T01:02:28.145ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "188c3e24-e614-4420-bcd2-c8499748605a", "date": "Thu, 11 Jan 2024 01:02:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4852024-01-11T01:02:28.145ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4862024-01-11T01:02:28.147ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/dns_propagation.rs:110 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4872024-01-11T01:02:28.147ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 155.70696ms iteration = 12
4882024-01-11T01:02:28.862ZINFOnexus: received new runtime state from sled agent file = nexus/src/app/instance.rs:1425 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 instance_state = InstanceRuntimeState { propolis_id: Some(b1f6f73e-258c-4dac-bcae-7d0dcfd824b5), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-01-11T01:02:03.677294349Z } propolis_id = b1f6f73e-258c-4dac-bcae-7d0dcfd824b5 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-01-11T01:02:28.862041948Z }
4892024-01-11T01:02:28.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
4902024-01-11T01:02:28.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
4912024-01-11T01:02:28.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
4922024-01-11T01:02:28.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
4932024-01-11T01:02:28.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
4942024-01-11T01:02:28.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
4952024-01-11T01:02:28.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
4962024-01-11T01:02:28.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
4972024-01-11T01:02:28.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
4982024-01-11T01:02:28.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
4992024-01-11T01:02:28.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5002024-01-11T01:02:28.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5012024-01-11T01:02:28.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5022024-01-11T01:02:28.874ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f090710e-c390-43cc-ac73-521c7e579a79, lookup_type: ById(f090710e-c390-43cc-ac73-521c7e579a79) }, key: a927764e-678c-443a-bc57-a1e8126ab062, lookup_type: ById(a927764e-678c-443a-bc57-a1e8126ab062) }, key: cbd9c8cf-b9a0-4e87-b36d-37053aea5882, lookup_type: ById(cbd9c8cf-b9a0-4e87-b36d-37053aea5882) } result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5032024-01-11T01:02:28.875ZDEBGnexus: instance state generation already advanced, won't touch network config instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5042024-01-11T01:02:28.884ZINFOnexus: instance and vmm updated by sled agent file = nexus/src/app/instance.rs:1561 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 instance_updated = false propolis_id = b1f6f73e-258c-4dac-bcae-7d0dcfd824b5 vmm_updated = true
5052024-01-11T01:02:28.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 22213 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = eb4d56c7-6645-4c61-a6ba-13f2ae7e13bd response_code = 204 uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5062024-01-11T01:02:28.885ZINFOnexus: received new runtime state from sled agent file = nexus/src/app/instance.rs:1425 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 instance_state = InstanceRuntimeState { propolis_id: Some(b1f6f73e-258c-4dac-bcae-7d0dcfd824b5), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-01-11T01:02:03.677294349Z } propolis_id = b1f6f73e-258c-4dac-bcae-7d0dcfd824b5 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-01-11T01:02:28.884696272Z }
5072024-01-11T01:02:28.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5082024-01-11T01:02:28.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5092024-01-11T01:02:28.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5102024-01-11T01:02:28.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5112024-01-11T01:02:28.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5122024-01-11T01:02:28.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5132024-01-11T01:02:28.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5142024-01-11T01:02:28.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5152024-01-11T01:02:28.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5162024-01-11T01:02:28.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5172024-01-11T01:02:28.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5182024-01-11T01:02:28.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5192024-01-11T01:02:28.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5202024-01-11T01:02:28.896ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f090710e-c390-43cc-ac73-521c7e579a79, lookup_type: ById(f090710e-c390-43cc-ac73-521c7e579a79) }, key: a927764e-678c-443a-bc57-a1e8126ab062, lookup_type: ById(a927764e-678c-443a-bc57-a1e8126ab062) }, key: cbd9c8cf-b9a0-4e87-b36d-37053aea5882, lookup_type: ById(cbd9c8cf-b9a0-4e87-b36d-37053aea5882) } result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5212024-01-11T01:02:28.896ZDEBGnexus: instance state generation already advanced, won't touch network config instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5222024-01-11T01:02:28.906ZINFOnexus: instance and vmm updated by sled agent file = nexus/src/app/instance.rs:1561 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 instance_updated = false propolis_id = b1f6f73e-258c-4dac-bcae-7d0dcfd824b5 vmm_updated = true
5232024-01-11T01:02:28.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 21730 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 7a8961cf-136e-44de-83ac-697701ba4a3d response_code = 204 uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5242024-01-11T01:02:29.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 3f438f5e-3d56-4468-8994-b11993bfd41f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/2?limit=100
5252024-01-11T01:02:29.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 3f438f5e-3d56-4468-8994-b11993bfd41f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/2?limit=100
5262024-01-11T01:02:29.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 3311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 3f438f5e-3d56-4468-8994-b11993bfd41f response_code = 200 uri = /nat/ipv4/changeset/2?limit=100
5272024-01-11T01:02:29.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 379dd5ae-883f-4d53-a3af-5ce536757082 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/4?limit=100
5282024-01-11T01:02:29.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 379dd5ae-883f-4d53-a3af-5ce536757082 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/4?limit=100
5292024-01-11T01:02:29.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 379dd5ae-883f-4d53-a3af-5ce536757082 response_code = 200 uri = /nat/ipv4/changeset/4?limit=100
5302024-01-11T01:02:30.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 9844a56f-63c4-4051-bb23-de89e94d1114 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/4?limit=100
5312024-01-11T01:02:30.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 9844a56f-63c4-4051-bb23-de89e94d1114 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/4?limit=100
5322024-01-11T01:02:30.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 9844a56f-63c4-4051-bb23-de89e94d1114 response_code = 200 uri = /nat/ipv4/changeset/4?limit=100
5332024-01-11T01:02:31.189ZINFOnexus: received new runtime state from sled agent file = nexus/src/app/instance.rs:1425 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-01-11T01:02:29.047116918Z } propolis_id = b1f6f73e-258c-4dac-bcae-7d0dcfd824b5 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-01-11T01:02:29.047116918Z }
5342024-01-11T01:02:31.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5352024-01-11T01:02:31.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5362024-01-11T01:02:31.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5372024-01-11T01:02:31.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5382024-01-11T01:02:31.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5392024-01-11T01:02:31.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5402024-01-11T01:02:31.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5412024-01-11T01:02:31.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5422024-01-11T01:02:31.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5432024-01-11T01:02:31.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5442024-01-11T01:02:31.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5452024-01-11T01:02:31.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5462024-01-11T01:02:31.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5472024-01-11T01:02:31.201ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f090710e-c390-43cc-ac73-521c7e579a79, lookup_type: ById(f090710e-c390-43cc-ac73-521c7e579a79) }, key: a927764e-678c-443a-bc57-a1e8126ab062, lookup_type: ById(a927764e-678c-443a-bc57-a1e8126ab062) }, key: cbd9c8cf-b9a0-4e87-b36d-37053aea5882, lookup_type: ById(cbd9c8cf-b9a0-4e87-b36d-37053aea5882) } result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5482024-01-11T01:02:31.201ZINFOnexus: instance cleared its Propolis ID, cleaning network config file = nexus/src/app/instance_network.rs:626 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 propolis_id = Some(b1f6f73e-258c-4dac-bcae-7d0dcfd824b5)
5492024-01-11T01:02:31.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5502024-01-11T01:02:31.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5512024-01-11T01:02:31.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5522024-01-11T01:02:31.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5532024-01-11T01:02:31.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5542024-01-11T01:02:31.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5552024-01-11T01:02:31.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5562024-01-11T01:02:31.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5572024-01-11T01:02:31.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5582024-01-11T01:02:31.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5592024-01-11T01:02:31.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5602024-01-11T01:02:31.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5612024-01-11T01:02:31.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5622024-01-11T01:02:31.213ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f090710e-c390-43cc-ac73-521c7e579a79, lookup_type: ById(f090710e-c390-43cc-ac73-521c7e579a79) }, key: a927764e-678c-443a-bc57-a1e8126ab062, lookup_type: ById(a927764e-678c-443a-bc57-a1e8126ab062) }, key: cbd9c8cf-b9a0-4e87-b36d-37053aea5882, lookup_type: ById(cbd9c8cf-b9a0-4e87-b36d-37053aea5882) } result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5632024-01-11T01:02:31.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5642024-01-11T01:02:31.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5652024-01-11T01:02:31.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5662024-01-11T01:02:31.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5672024-01-11T01:02:31.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5682024-01-11T01:02:31.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5692024-01-11T01:02:31.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5702024-01-11T01:02:31.219ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f090710e-c390-43cc-ac73-521c7e579a79, lookup_type: ById(f090710e-c390-43cc-ac73-521c7e579a79) }, key: a927764e-678c-443a-bc57-a1e8126ab062, lookup_type: ById(a927764e-678c-443a-bc57-a1e8126ab062) }, key: cbd9c8cf-b9a0-4e87-b36d-37053aea5882, lookup_type: ById(cbd9c8cf-b9a0-4e87-b36d-37053aea5882) } result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5712024-01-11T01:02:31.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5722024-01-11T01:02:31.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5732024-01-11T01:02:31.223ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5742024-01-11T01:02:31.223ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5752024-01-11T01:02:31.224ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
5762024-01-11T01:02:31.225ZDEBGnexus (InstanceAllocator): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
5772024-01-11T01:02:31.225ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5782024-01-11T01:02:31.225ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5792024-01-11T01:02:31.227ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5802024-01-11T01:02:31.228ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5812024-01-11T01:02:31.229ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5822024-01-11T01:02:31.229ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5832024-01-11T01:02:31.230ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
5842024-01-11T01:02:31.232ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: a7799a8b-94f0-42da-bdb6-695ecc23a8c9, lookup_type: ById(a7799a8b-94f0-42da-bdb6-695ecc23a8c9) } result = Ok(())
5852024-01-11T01:02:31.261ZDEBGnexus: client request SledAgent = a7799a8b-94f0-42da-bdb6-695ecc23a8c9 body = Some(Body) method = DELETE uri = http://[fd00:1122:3344:101::1]:12345/v2p/fefa9976-3f50-48de-bfe5-5ede49af0b8e
5862024-01-11T01:02:31.262ZDEBGnexus: client response SledAgent = a7799a8b-94f0-42da-bdb6-695ecc23a8c9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p/fefa9976-3f50-48de-bfe5-5ede49af0b8e", query: None, fragment: None }, status: 204, headers: {"x-request-id": "04c3fa65-9c80-483e-a41c-1e79c2e08748", "date": "Thu, 11 Jan 2024 01:02:31 GMT"} })
5872024-01-11T01:02:31.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5882024-01-11T01:02:31.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5892024-01-11T01:02:31.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5902024-01-11T01:02:31.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5912024-01-11T01:02:31.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5922024-01-11T01:02:31.268ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Fleet result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5932024-01-11T01:02:31.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5942024-01-11T01:02:31.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5952024-01-11T01:02:31.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5962024-01-11T01:02:31.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5972024-01-11T01:02:31.278ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:543
5982024-01-11T01:02:31.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
5992024-01-11T01:02:31.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6002024-01-11T01:02:31.279ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:543
6012024-01-11T01:02:31.279ZDEBGnexus: notifying dendrite of updates instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 switch = switch0
6022024-01-11T01:02:31.279ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
6032024-01-11T01:02:31.280ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ceb491fa-dfd5-4b65-92f2-43f768d41f07", "content-length": "4", "date": "Thu, 11 Jan 2024 01:02:31 GMT"} })
6042024-01-11T01:02:31.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6052024-01-11T01:02:31.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6062024-01-11T01:02:31.301ZDEBGnexus: deleted metric producer assignment collector_id = d73910c9-6d38-423e-81af-7c554381f9b2 producer_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6072024-01-11T01:02:31.333ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:374 id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6082024-01-11T01:02:31.333ZDEBGnexus: client request body = None method = DELETE oximeter-collector = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 uri = http://[fd00:1122:3344:101::d]:12223/producers/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6092024-01-11T01:02:31.339ZDEBGnexus: client response oximeter-collector = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/cbd9c8cf-b9a0-4e87-b36d-37053aea5882", query: None, fragment: None }, status: 204, headers: {"x-request-id": "38148d8d-26c7-4141-8264-2e2eff20585b", "date": "Thu, 11 Jan 2024 01:02:31 GMT"} })
6102024-01-11T01:02:31.339ZDEBGnexus: successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = d73910c9-6d38-423e-81af-7c554381f9b2 producer_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6112024-01-11T01:02:31.351ZINFOnexus: vmm is terminated, cleaning up resources file = nexus/src/app/instance.rs:1538 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 propolis_id = b1f6f73e-258c-4dac-bcae-7d0dcfd824b5
6122024-01-11T01:02:31.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6132024-01-11T01:02:31.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6142024-01-11T01:02:31.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 roles = RoleSet { roles: {} } uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6152024-01-11T01:02:31.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 resource = Database result = Ok(()) uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6162024-01-11T01:02:31.360ZINFOnexus: instance and vmm updated by sled agent file = nexus/src/app/instance.rs:1561 instance_id = cbd9c8cf-b9a0-4e87-b36d-37053aea5882 instance_updated = true propolis_id = b1f6f73e-258c-4dac-bcae-7d0dcfd824b5 vmm_updated = true
6172024-01-11T01:02:31.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 171018 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59709 req_id = 0726fb32-f491-4f0a-810c-4fd41d68f4b7 response_code = 204 uri = /instances/cbd9c8cf-b9a0-4e87-b36d-37053aea5882
6182024-01-11T01:02:31.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = a9ca411d-f65b-4214-b020-5bb98c7b9ca8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/4?limit=100
6192024-01-11T01:02:31.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = a9ca411d-f65b-4214-b020-5bb98c7b9ca8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/4?limit=100
6202024-01-11T01:02:31.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 2883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = a9ca411d-f65b-4214-b020-5bb98c7b9ca8 response_code = 200 uri = /nat/ipv4/changeset/4?limit=100
6212024-01-11T01:02:33.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = c2cc2ae4-32a1-43e8-b14d-cc2c9b9d3429 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
6222024-01-11T01:02:43.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = d4cc6d2b-ed69-4799-8df6-710d0b2eb9a5 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
6232024-01-11T01:02:53.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = addab698-3540-48ec-83eb-22fe99219073 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
6242024-01-11T01:02:57.992ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
6252024-01-11T01:02:57.992ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:50
6262024-01-11T01:02:57.992ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
6272024-01-11T01:02:57.992ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6282024-01-11T01:02:57.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6292024-01-11T01:02:57.994ZDEBGnexus (DpdClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6302024-01-11T01:02:57.995ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14aa403d-dae9-4555-b7d1-f3adced1c344", "content-length": "1", "date": "Thu, 11 Jan 2024 01:02:57 GMT"} })
6312024-01-11T01:02:57.995ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6322024-01-11T01:02:57.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6332024-01-11T01:02:57.995ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:96
6342024-01-11T01:02:57.995ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.146499ms iteration = 17
6352024-01-11T01:02:57.996ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 4.404836ms iteration = 17
6362024-01-11T01:03:01.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = c154adcd-a018-488a-803a-e74a0cbec37e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/4?limit=100
6372024-01-11T01:03:01.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = c154adcd-a018-488a-803a-e74a0cbec37e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/4?limit=100
6382024-01-11T01:03:01.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 2799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = c154adcd-a018-488a-803a-e74a0cbec37e response_code = 200 uri = /nat/ipv4/changeset/4?limit=100
6392024-01-11T01:03:03.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = e3593fb5-1534-497d-9629-9ff8a7c11539 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
6402024-01-11T01:03:13.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 5ada243e-6f36-46e1-a033-41bf92d38ae0 response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
6412024-01-11T01:03:23.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 6452e703-563b-43bf-a2b3-79d0a5d84b4e response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
6422024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
6432024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
6442024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
6452024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
6462024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6472024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
6482024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {} }
6492024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {} }
6502024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
6512024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
6522024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
6532024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6542024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6552024-01-11T01:03:27.991ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
6562024-01-11T01:03:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6572024-01-11T01:03:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Database result = Ok(())
6582024-01-11T01:03:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6592024-01-11T01:03:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Database result = Ok(())
6602024-01-11T01:03:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6612024-01-11T01:03:27.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6622024-01-11T01:03:27.992ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
6632024-01-11T01:03:27.992ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
6642024-01-11T01:03:27.992ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:50
6652024-01-11T01:03:27.992ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6662024-01-11T01:03:27.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6672024-01-11T01:03:27.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6682024-01-11T01:03:27.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6692024-01-11T01:03:27.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6702024-01-11T01:03:27.994ZDEBGnexus (DpdClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6712024-01-11T01:03:27.994ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6722024-01-11T01:03:27.994ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b4bf35c2-ac6d-496c-9302-f8148229a47b", "content-length": "1", "date": "Thu, 11 Jan 2024 01:03:27 GMT"} })
6732024-01-11T01:03:27.994ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6742024-01-11T01:03:27.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6752024-01-11T01:03:27.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6762024-01-11T01:03:27.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6772024-01-11T01:03:27.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6782024-01-11T01:03:27.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6792024-01-11T01:03:27.995ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:96
6802024-01-11T01:03:27.995ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.911063ms iteration = 18
6812024-01-11T01:03:27.996ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 3.325012ms iteration = 18
6822024-01-11T01:03:27.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6832024-01-11T01:03:27.997ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6842024-01-11T01:03:27.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Fleet result = Ok(())
6852024-01-11T01:03:27.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_external dns_group = external roles = RoleSet { roles: {} }
6862024-01-11T01:03:27.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6872024-01-11T01:03:27.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_external dns_group = external resource = Database result = Ok(())
6882024-01-11T01:03:27.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Fleet result = Ok(())
6892024-01-11T01:03:27.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_servers_internal dns_group = internal roles = RoleSet { roles: {} }
6902024-01-11T01:03:27.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_servers_internal dns_group = internal resource = Database result = Ok(())
6912024-01-11T01:03:27.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6922024-01-11T01:03:27.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6932024-01-11T01:03:27.999ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6942024-01-11T01:03:27.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6952024-01-11T01:03:27.999ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6962024-01-11T01:03:27.999ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6972024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6982024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6992024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
7002024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 8.330092ms iteration = 11
7012024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7022024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
7032024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 8.611947ms iteration = 11
7042024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
7052024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
7062024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
7072024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7082024-01-11T01:03:28.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7092024-01-11T01:03:28.001ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7102024-01-11T01:03:28.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7112024-01-11T01:03:28.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7122024-01-11T01:03:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
7132024-01-11T01:03:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7142024-01-11T01:03:28.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7152024-01-11T01:03:28.004ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7162024-01-11T01:03:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7172024-01-11T01:03:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7182024-01-11T01:03:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7192024-01-11T01:03:28.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7202024-01-11T01:03:28.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7212024-01-11T01:03:28.006ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7222024-01-11T01:03:28.006ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = f9e01a1e-655a-477b-b0f5-22e3db0586ec dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7232024-01-11T01:03:28.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7242024-01-11T01:03:28.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7252024-01-11T01:03:28.006ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7262024-01-11T01:03:28.006ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 67120ed0-9222-49a7-9d6f-b2dbd25bde25 dns_zone_name = oxide.test found_so_far = 0 version = 2
7272024-01-11T01:03:28.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7282024-01-11T01:03:28.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7292024-01-11T01:03:28.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7302024-01-11T01:03:28.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7312024-01-11T01:03:28.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7322024-01-11T01:03:28.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7332024-01-11T01:03:28.007ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7342024-01-11T01:03:28.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7352024-01-11T01:03:28.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7362024-01-11T01:03:28.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7372024-01-11T01:03:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7382024-01-11T01:03:28.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7392024-01-11T01:03:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7402024-01-11T01:03:28.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7412024-01-11T01:03:28.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7422024-01-11T01:03:28.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7432024-01-11T01:03:28.011ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 67120ed0-9222-49a7-9d6f-b2dbd25bde25 dns_zone_name = oxide.test found_so_far = 1 version = 2
7442024-01-11T01:03:28.011ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7452024-01-11T01:03:28.011ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-01-11 00:55:59.472363 UTC dns_group = external generation = 2
7462024-01-11T01:03:28.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 20.046047ms iteration = 11
7472024-01-11T01:03:28.012ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = f9e01a1e-655a-477b-b0f5-22e3db0586ec dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7482024-01-11T01:03:28.012ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7492024-01-11T01:03:28.012ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-01-11 00:55:59.078467 UTC dns_group = internal generation = 1
7502024-01-11T01:03:28.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 20.887015ms iteration = 11
7512024-01-11T01:03:28.016ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-01-11T00:55:28.054310Z, time_modified: 2024-01-11T00:55:28.054310Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f090710e-c390-43cc-ac73-521c7e579a79, db_silo: Silo { identity: SiloIdentity { id: f090710e-c390-43cc-ac73-521c7e579a79, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-01-11T00:55:59.446411Z, time_modified: 2024-01-11T00:55:59.446411Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "262b888f144019b1d68f6e4aa4b850bc6d171be00b1cf3fe17726b4cf1d4a104" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f090710e-c390-43cc-ac73-521c7e579a79, db_silo: Silo { identity: SiloIdentity { id: f090710e-c390-43cc-ac73-521c7e579a79, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-01-11T00:55:59.446411Z, time_modified: 2024-01-11T00:55:59.446411Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "262b888f144019b1d68f6e4aa4b850bc6d171be00b1cf3fe17726b4cf1d4a104" }] }) }
7522024-01-11T01:03:28.016ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 25.059805ms iteration = 11
7532024-01-11T01:03:28.056ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7542024-01-11T01:03:28.057ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7552024-01-11T01:03:28.115ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7562024-01-11T01:03:28.116ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7572024-01-11T01:03:28.116ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7e637837-fcc0-4166-ab8f-d90092dac979", "date": "Thu, 11 Jan 2024 01:03:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7582024-01-11T01:03:28.116ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7592024-01-11T01:03:28.118ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "da83ffa9-9c21-483c-8c48-d74098905539", "date": "Thu, 11 Jan 2024 01:03:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7602024-01-11T01:03:28.118ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7612024-01-11T01:03:28.119ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/dns_propagation.rs:110 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7622024-01-11T01:03:28.119ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 127.605839ms iteration = 13
7632024-01-11T01:03:28.146ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7642024-01-11T01:03:28.147ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2ca02abb-a214-474e-9de7-f78c4c5fb003", "date": "Thu, 11 Jan 2024 01:03:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7652024-01-11T01:03:28.147ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7662024-01-11T01:03:28.149ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b772921f-1248-4d1d-90a2-c3fc635b4234", "date": "Thu, 11 Jan 2024 01:03:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7672024-01-11T01:03:28.149ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7682024-01-11T01:03:28.150ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "81183233-394d-4105-b0fd-b8ce7e560cd2", "date": "Thu, 11 Jan 2024 01:03:28 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7692024-01-11T01:03:28.150ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/dns_propagation.rs:173 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7702024-01-11T01:03:28.151ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/dns_propagation.rs:110 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
7712024-01-11T01:03:28.151ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 159.590235ms iteration = 13
7722024-01-11T01:03:31.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 658aa075-4fde-4471-9803-68bfafdd7b1a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/4?limit=100
7732024-01-11T01:03:31.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 658aa075-4fde-4471-9803-68bfafdd7b1a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/4?limit=100
7742024-01-11T01:03:31.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 2931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41951 req_id = 658aa075-4fde-4471-9803-68bfafdd7b1a response_code = 200 uri = /nat/ipv4/changeset/4?limit=100
7752024-01-11T01:03:33.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = 8c8f371e-42ea-4505-9a4a-7ee627771cac response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf
7762024-01-11T01:03:43.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34249 req_id = a8f2920f-dd65-4b98-a023-4c8d84a8ed5d response_code = 200 uri = /metrics/collect/250f18c8-27e5-40dc-abe7-db9aec48e3bf