Max level shown:
1 [ Dec 19 22:59:02 Enabled. ]
2 [ Dec 19 22:59:02 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 19 22:59:02 Method "start" exited with status 0. ]
4 [ Dec 19 22:59:02 Rereading configuration. ]
5 [ Dec 19 22:59:02 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72023-12-19T22:59:02.865ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:240
82023-12-19T22:59:02.914ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:247
92023-12-19T22:59:02.914ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
102023-12-19T22:59:03.026ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
112023-12-19T22:59:03.035ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
122023-12-19T22:59:03.043ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:257 path = /var/run/oxide/
132023-12-19T22:59:03.639ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:a02a::, len: 64 }
142023-12-19T22:59:03.780ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:117
152023-12-19T22:59:03.780ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:129
162023-12-19T22:59:03.780ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:141
172023-12-19T22:59:03.780ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:162 sled_mode = Scrimlet { asic: SoftNpuZone }
182023-12-19T22:59:03.780ZINFOSledAgent (DumpSetup-archival): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:171
192023-12-19T22:59:03.780ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:606
202023-12-19T22:59:03.780ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:532
212023-12-19T22:59:03.783ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "c42f8e572c524e4a95ee5da38884f6f2", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:532
222023-12-19T22:59:03.783ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:655
232023-12-19T22:59:03.783ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:176
242023-12-19T22:59:03.783ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:713
252023-12-19T22:59:03.783ZINFOSledAgent: Upserting synthetic zpool to Storage Manager: oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b file = sled-agent/src/long_running_tasks.rs:232
262023-12-19T22:59:03.783ZINFOSledAgent: Upserting synthetic zpool to Storage Manager: oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b file = sled-agent/src/long_running_tasks.rs:232
272023-12-19T22:59:03.783ZINFOSledAgent: Upserting synthetic zpool to Storage Manager: oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b file = sled-agent/src/long_running_tasks.rs:232
282023-12-19T22:59:03.783ZINFOSledAgent: Upserting synthetic zpool to Storage Manager: oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 file = sled-agent/src/long_running_tasks.rs:232
292023-12-19T22:59:03.783ZINFOSledAgent: Upserting synthetic zpool to Storage Manager: oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 file = sled-agent/src/long_running_tasks.rs:232
302023-12-19T22:59:03.783ZINFOSledAgent: Upserting synthetic zpool to Storage Manager: oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 file = sled-agent/src/long_running_tasks.rs:232
312023-12-19T22:59:03.783ZINFOSledAgent: Upserting synthetic zpool to Storage Manager: oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 file = sled-agent/src/long_running_tasks.rs:232
322023-12-19T22:59:03.783ZINFOSledAgent: Upserting synthetic zpool to Storage Manager: oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 file = sled-agent/src/long_running_tasks.rs:232
332023-12-19T22:59:03.783ZINFOSledAgent: Upserting synthetic zpool to Storage Manager: oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 file = sled-agent/src/long_running_tasks.rs:232
342023-12-19T22:59:03.783ZINFOSledAgent: Upserting synthetic zpool to Storage Manager: oxp_31bd71cd-4736-4a12-a387-9b74b050396f file = sled-agent/src/long_running_tasks.rs:232
352023-12-19T22:59:03.783ZINFOSledAgent: Upserting synthetic zpool to Storage Manager: oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 file = sled-agent/src/long_running_tasks.rs:232
362023-12-19T22:59:03.783ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot file = sled-agent/src/hardware_monitor.rs:241 underlay_network_info = None
372023-12-19T22:59:03.783ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:88
382023-12-19T22:59:03.783ZINFOSledAgent (StorageManager): Received AddDisk(Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, zpool_name: ZpoolName { id: a462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal } })) file = sled-storage/src/manager.rs:346
392023-12-19T22:59:03.967ZINFOSledAgent (StorageManager): Channel capacity decreased current = 245 file = sled-storage/src/manager.rs:326 previous = 256
402023-12-19T22:59:03.967ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } file = sled-agent/src/long_running_tasks.rs:90
412023-12-19T22:59:03.967ZINFOSledAgent (StorageManager): Received AddDisk(Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, zpool_name: ZpoolName { id: b462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal } })) file = sled-storage/src/manager.rs:346
422023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Received AddDisk(Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, zpool_name: ZpoolName { id: d462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: External } })) file = sled-storage/src/manager.rs:346
432023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Received AddDisk(Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, zpool_name: ZpoolName { id: e4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } })) file = sled-storage/src/manager.rs:346
442023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Received AddDisk(Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, zpool_name: ZpoolName { id: f4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } })) file = sled-storage/src/manager.rs:346
452023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Received AddDisk(Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, zpool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } })) file = sled-storage/src/manager.rs:346
462023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Received AddDisk(Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, zpool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } })) file = sled-storage/src/manager.rs:346
472023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Received AddDisk(Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", model: "synthetic-model" }, zpool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External } })) file = sled-storage/src/manager.rs:346
482023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Received AddDisk(Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", model: "synthetic-model" }, zpool_name: ZpoolName { id: ceb4461c-cf56-4719-ad3c-14430bfdfb60, kind: External } })) file = sled-storage/src/manager.rs:346
492023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Received AddDisk(Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", model: "synthetic-model" }, zpool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External } })) file = sled-storage/src/manager.rs:346
502023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Received AddDisk(Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", model: "synthetic-model" }, zpool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External } })) file = sled-storage/src/manager.rs:346
512023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Received DisksChanged({}) file = sled-storage/src/manager.rs:346
522023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Channel capacity increased current = 255 file = sled-storage/src/manager.rs:336 previous = 245
532023-12-19T22:59:04.152ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
542023-12-19T22:59:04.153ZINFOSledAgent (StorageMonitor): Received storage manager update file = sled-agent/src/storage_monitor.rs:111 resources = StorageResources { disks: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, zpool_name: ZpoolName { id: a462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal } }), Pool { name: ZpoolName { id: a462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal }, info: ZpoolInfo { name: "oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b", size: 20937965568, allocated: 493056, free: 20937472512, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } }), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, zpool_name: ZpoolName { id: b462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal } }), Pool { name: ZpoolName { id: b462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal }, info: ZpoolInfo { name: "oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b", size: 20937965568, allocated: 884736, free: 20937080832, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } })} }
552023-12-19T22:59:04.153ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:200
562023-12-19T22:59:04.153ZINFOSledAgent (bootstore): No ledger in /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:187 peer_id = pc-c42f8e572c524e4a95ee5da38884f6f2-i86pc
572023-12-19T22:59:04.153ZINFOSledAgent (bootstore): No ledger in /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:187 peer_id = pc-c42f8e572c524e4a95ee5da38884f6f2-i86pc
582023-12-19T22:59:04.153ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-c42f8e572c524e4a95ee5da38884f6f2-i86pc
592023-12-19T22:59:04.153ZINFOSledAgent (bootstore): No ledger in /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/cluster/bootstore-network-config.json file = common/src/ledger.rs:187 peer_id = pc-c42f8e572c524e4a95ee5da38884f6f2-i86pc
602023-12-19T22:59:04.153ZINFOSledAgent (bootstore): No ledger in /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/cluster/bootstore-network-config.json file = common/src/ledger.rs:187 peer_id = pc-c42f8e572c524e4a95ee5da38884f6f2-i86pc
612023-12-19T22:59:04.153ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-c42f8e572c524e4a95ee5da38884f6f2-i86pc
622023-12-19T22:59:04.153ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:205
632023-12-19T22:59:04.153ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:220
642023-12-19T22:59:04.167ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:575
652023-12-19T22:59:04.167ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:288 next_cleanup = Instant { tv_sec: 4686, tv_nsec: 138550223 } time_to_next_cleanup = 599.99994101s
662023-12-19T22:59:04.167ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3037
672023-12-19T22:59:04.167ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
682023-12-19T22:59:04.167ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/sled-agent-request.json file = common/src/ledger.rs:187
692023-12-19T22:59:04.170ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/sled-agent-request.json file = common/src/ledger.rs:187
702023-12-19T22:59:04.170ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:195 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
712023-12-19T22:59:04.170ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
722023-12-19T22:59:04.171ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { rack_subnet: fd00:1122:3344:100::, trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: Some( RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:1::, prefix: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.2.100, }, ], addresses: [ V4( Ipv4Network { addr: 10.151.2.174, prefix: 32, }, ), ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], }, ), } file = sled-agent/src/rack_setup/service.rs:803
732023-12-19T22:59:04.171ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
742023-12-19T22:59:04.171ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
752023-12-19T22:59:04.171ZINFOSledAgent (RSS): No ledger in /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/rss-plan-completed.marker file = common/src/ledger.rs:187
762023-12-19T22:59:04.171ZINFOSledAgent (RSS): No ledger in /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/rss-plan-completed.marker file = common/src/ledger.rs:187
772023-12-19T22:59:04.171ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:863
782023-12-19T22:59:04.171ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
792023-12-19T22:59:04.171ZINFOSledAgent (RSS): No ledger in /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/rss-sled-plan.json file = common/src/ledger.rs:187
802023-12-19T22:59:04.171ZINFOSledAgent (RSS): No ledger in /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/rss-sled-plan.json file = common/src/ledger.rs:187
812023-12-19T22:59:04.171ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:904
822023-12-19T22:59:04.171ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:118
832023-12-19T22:59:04.171ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:91
842023-12-19T22:59:04.171ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
852023-12-19T22:59:04.171ZINFOSledAgent (RSS): Writing ledger to /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:198
862023-12-19T22:59:04.171ZINFOSledAgent (RSS): Writing ledger to /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:198
872023-12-19T22:59:04.171ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:138
882023-12-19T22:59:04.171ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:937
892023-12-19T22:59:04.171ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:556 peer_id = pc-c42f8e572c524e4a95ee5da38884f6f2-i86pc
902023-12-19T22:59:04.171ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:198 peer_id = pc-c42f8e572c524e4a95ee5da38884f6f2-i86pc
912023-12-19T22:59:04.172ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:198 peer_id = pc-c42f8e572c524e4a95ee5da38884f6f2-i86pc
922023-12-19T22:59:04.172ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:640 peer_id = pc-c42f8e572c524e4a95ee5da38884f6f2-i86pc
932023-12-19T22:59:04.172ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 097821eb-36d2-4a1a-98a7-92f64e03f037, rack_id: a900c9d8-85d5-4d11-8e94-59a15fbbcc5a, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
942023-12-19T22:59:04.172ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:a02a::1]:45575
952023-12-19T22:59:04.172ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 097821eb-36d2-4a1a-98a7-92f64e03f037, rack_id: a900c9d8-85d5-4d11-8e94-59a15fbbcc5a, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } file = sled-agent/src/bootstrap/server.rs:364
962023-12-19T22:59:04.172ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:379
972023-12-19T22:59:04.172ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:47
982023-12-19T22:59:04.172ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
992023-12-19T22:59:04.172ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:346
1002023-12-19T22:59:04.172ZINFOSledAgent (StorageManager): Attempting to add queued disks file = sled-storage/src/manager.rs:394 num_disks = 9
1012023-12-19T22:59:04.175ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3265
1022023-12-19T22:59:04.181ZINFOSledAgent (StorageManager): Loading latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} file = sled-storage/src/dataset.rs:261
1032023-12-19T22:59:04.181ZINFOSledAgent (StorageManager): Loaded latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:263
1042023-12-19T22:59:04.181ZINFOSledAgent (StorageManager): Retrieving key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:267
1052023-12-19T22:59:04.181ZINFOSledAgent (StorageManager): Got key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:269
1062023-12-19T22:59:04.181ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:37
1072023-12-19T22:59:04.181ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:281
1082023-12-19T22:59:04.212ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:56
1092023-12-19T22:59:04.219ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {}
1102023-12-19T22:59:04.220ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone file = sled-storage/src/dataset.rs:323
1112023-12-19T22:59:04.239ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:309 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
1122023-12-19T22:59:04.239ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
1132023-12-19T22:59:04.341ZINFOSledAgent (StorageManager): Loading latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60",\n model: "synthetic-model",\n} file = sled-storage/src/dataset.rs:261
1142023-12-19T22:59:04.341ZINFOSledAgent (StorageManager): Loaded latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:263
1152023-12-19T22:59:04.341ZINFOSledAgent (StorageManager): Retrieving key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:267
1162023-12-19T22:59:04.341ZINFOSledAgent (StorageManager): Got key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:269
1172023-12-19T22:59:04.341ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:37
1182023-12-19T22:59:04.341ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:281
1192023-12-19T22:59:04.370ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:56
1202023-12-19T22:59:04.377ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone file = sled-storage/src/dataset.rs:323
1212023-12-19T22:59:04.499ZINFOSledAgent (StorageManager): Loading latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7",\n model: "synthetic-model",\n} file = sled-storage/src/dataset.rs:261
1222023-12-19T22:59:04.499ZINFOSledAgent (StorageManager): Loaded latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:263
1232023-12-19T22:59:04.499ZINFOSledAgent (StorageManager): Retrieving key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:267
1242023-12-19T22:59:04.499ZINFOSledAgent (StorageManager): Got key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:269
1252023-12-19T22:59:04.499ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:37
1262023-12-19T22:59:04.499ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:281
1272023-12-19T22:59:04.525ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:56
1282023-12-19T22:59:04.534ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone file = sled-storage/src/dataset.rs:323
1292023-12-19T22:59:04.656ZINFOSledAgent (StorageManager): Loading latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f",\n model: "synthetic-model",\n} file = sled-storage/src/dataset.rs:261
1302023-12-19T22:59:04.656ZINFOSledAgent (StorageManager): Loaded latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:263
1312023-12-19T22:59:04.656ZINFOSledAgent (StorageManager): Retrieving key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:267
1322023-12-19T22:59:04.656ZINFOSledAgent (StorageManager): Got key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:269
1332023-12-19T22:59:04.656ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:37
1342023-12-19T22:59:04.656ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:281
1352023-12-19T22:59:04.683ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:56
1362023-12-19T22:59:04.691ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone file = sled-storage/src/dataset.rs:323
1372023-12-19T22:59:04.811ZINFOSledAgent (StorageManager): Loading latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930",\n model: "synthetic-model",\n} file = sled-storage/src/dataset.rs:261
1382023-12-19T22:59:04.811ZINFOSledAgent (StorageManager): Loaded latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:263
1392023-12-19T22:59:04.811ZINFOSledAgent (StorageManager): Retrieving key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:267
1402023-12-19T22:59:04.811ZINFOSledAgent (StorageManager): Got key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:269
1412023-12-19T22:59:04.812ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:37
1422023-12-19T22:59:04.812ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:281
1432023-12-19T22:59:04.840ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:56
1442023-12-19T22:59:04.847ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone file = sled-storage/src/dataset.rs:323
1452023-12-19T22:59:04.969ZINFOSledAgent (StorageManager): Loading latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} file = sled-storage/src/dataset.rs:261
1462023-12-19T22:59:04.969ZINFOSledAgent (StorageManager): Loaded latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:263
1472023-12-19T22:59:04.969ZINFOSledAgent (StorageManager): Retrieving key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:267
1482023-12-19T22:59:04.969ZINFOSledAgent (StorageManager): Got key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:269
1492023-12-19T22:59:04.969ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:37
1502023-12-19T22:59:04.969ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:281
1512023-12-19T22:59:04.997ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:56
1522023-12-19T22:59:05.006ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone file = sled-storage/src/dataset.rs:323
1532023-12-19T22:59:05.128ZINFOSledAgent (StorageManager): Loading latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} file = sled-storage/src/dataset.rs:261
1542023-12-19T22:59:05.128ZINFOSledAgent (StorageManager): Loaded latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:263
1552023-12-19T22:59:05.128ZINFOSledAgent (StorageManager): Retrieving key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:267
1562023-12-19T22:59:05.128ZINFOSledAgent (StorageManager): Got key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:269
1572023-12-19T22:59:05.128ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:37
1582023-12-19T22:59:05.128ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:281
1592023-12-19T22:59:05.156ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:56
1602023-12-19T22:59:05.163ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone file = sled-storage/src/dataset.rs:323
1612023-12-19T22:59:05.285ZINFOSledAgent (StorageManager): Loading latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b",\n model: "synthetic-model",\n} file = sled-storage/src/dataset.rs:261
1622023-12-19T22:59:05.285ZINFOSledAgent (StorageManager): Loaded latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:263
1632023-12-19T22:59:05.285ZINFOSledAgent (StorageManager): Retrieving key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:267
1642023-12-19T22:59:05.285ZINFOSledAgent (StorageManager): Got key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:269
1652023-12-19T22:59:05.286ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:37
1662023-12-19T22:59:05.286ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:281
1672023-12-19T22:59:05.315ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:56
1682023-12-19T22:59:05.322ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone file = sled-storage/src/dataset.rs:323
1692023-12-19T22:59:05.443ZINFOSledAgent (StorageManager): Loading latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} file = sled-storage/src/dataset.rs:261
1702023-12-19T22:59:05.443ZINFOSledAgent (StorageManager): Loaded latest secret disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:263
1712023-12-19T22:59:05.443ZINFOSledAgent (StorageManager): Retrieving key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:267
1722023-12-19T22:59:05.443ZINFOSledAgent (StorageManager): Got key disk_id = DiskIdentity {\n vendor: "synthetic-vendor",\n serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03",\n model: "synthetic-model",\n} epoch = 0 file = sled-storage/src/dataset.rs:269
1732023-12-19T22:59:05.443ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:37
1742023-12-19T22:59:05.443ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:281
1752023-12-19T22:59:05.471ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03-synthetic-model-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:56
1762023-12-19T22:59:05.478ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone file = sled-storage/src/dataset.rs:323
1772023-12-19T22:59:05.589ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
1782023-12-19T22:59:05.589ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
1792023-12-19T22:59:05.589ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:321 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
1802023-12-19T22:59:05.595ZINFOSledAgent (StorageMonitor): Received storage manager update file = sled-agent/src/storage_monitor.rs:111 resources = StorageResources { disks: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, zpool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }), Pool { name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, info: ZpoolInfo { name: "oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03", size: 20937965568, allocated: 823296, free: 20937142272, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } }), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, zpool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }), Pool { name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, info: ZpoolInfo { name: "oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03", size: 20937965568, allocated: 771072, free: 20937194496, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } }), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", model: "synthetic-model" }, zpool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External } }), Pool { name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, info: ZpoolInfo { name: "oxp_31bd71cd-4736-4a12-a387-9b74b050396f", size: 20937965568, allocated: 772608, free: 20937192960, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", model: "synthetic-model" } }), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", model: "synthetic-model" }, zpool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External } }), Pool { name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, info: ZpoolInfo { name: "oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7", size: 20937965568, allocated: 817152, free: 20937148416, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", model: "synthetic-model" } }), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, zpool_name: ZpoolName { id: a462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal } }), Pool { name: ZpoolName { id: a462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal }, info: ZpoolInfo { name: "oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b", size: 20937965568, allocated: 493056, free: 20937472512, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } }), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, zpool_name: ZpoolName { id: b462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal } }), Pool { name: ZpoolName { id: b462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal }, info: ZpoolInfo { name: "oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b", size: 20937965568, allocated: 884736, free: 20937080832, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } }), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", model: "synthetic-model" }, zpool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External } }), Pool { name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External }, info: ZpoolInfo { name: "oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930", size: 20937965568, allocated: 774144, free: 20937191424, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", model: "synthetic-model" } }), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", model: "synthetic-model" }, zpool_name: ZpoolName { id: ceb4461c-cf56-4719-ad3c-14430bfdfb60, kind: External } }), Pool { name: ZpoolName { id: ceb4461c-cf56-4719-ad3c-14430bfdfb60, kind: External }, info: ZpoolInfo { name: "oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60", size: 20937965568, allocated: 1774080, free: 20936191488, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", model: "synthetic-model" } }), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, zpool_name: ZpoolName { id: d462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: External } }), Pool { name: ZpoolName { id: d462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: External }, info: ZpoolInfo { name: "oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b", size: 20937965568, allocated: 769536, free: 20937196032, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } }), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, zpool_name: ZpoolName { id: e4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }), Pool { name: ZpoolName { id: e4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, info: ZpoolInfo { name: "oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03", size: 20937965568, allocated: 817152, free: 20937148416, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } }), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }: (Synthetic(SyntheticDisk { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, zpool_name: ZpoolName { id: f4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }), Pool { name: ZpoolName { id: f4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, info: ZpoolInfo { name: "oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03", size: 20937965568, allocated: 774144, free: 20937191424, health: Online }, parent: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } })} }
1812023-12-19T22:59:05.612ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1822023-12-19T22:59:05.614ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:314
1832023-12-19T22:59:05.632ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:353
1842023-12-19T22:59:05.634ZINFOSledAgent: successfully created encrypted zvol: name="oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1852023-12-19T22:59:05.635ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/swap" file = sled-agent/src/swap_device.rs:96
1862023-12-19T22:59:05.640ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:336 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
1872023-12-19T22:59:05.640ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1882023-12-19T22:59:05.640ZINFOSledAgent (BackingFs): Ensuring dataset oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/backing/fmd file = sled-agent/src/backing_fs.rs:136
1892023-12-19T22:59:05.701ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1902023-12-19T22:59:05.919ZINFOSledAgent (BackingFs): Mounting oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1912023-12-19T22:59:05.931ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1922023-12-19T22:59:05.931ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1932023-12-19T22:59:05.931ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1942023-12-19T22:59:05.931ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1952023-12-19T22:59:06.094ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:162
1962023-12-19T22:59:06.639ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:80 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
1972023-12-19T22:59:06.639ZINFOSledAgent (StorageMonitor): Underlay Available file = sled-agent/src/storage_monitor.rs:122 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
1982023-12-19T22:59:06.639ZINFOSledAgent (InstanceManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/instance_manager.rs:177
1992023-12-19T22:59:06.639ZINFOSledAgent (InstanceManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/instance_manager.rs:185
2002023-12-19T22:59:06.654ZINFOSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/14b4dc87-ab46-49fb-a4b4-d361ae214c03): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:270
2012023-12-19T22:59:06.664ZINFOSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:219
2022023-12-19T22:59:06.664ZINFOSledAgent (StorageMonitor): failed to notify nexus about a new pool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/a462a7f7-b628-40fe-80ff-4e4189e2d62b): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:270
2032023-12-19T22:59:06.664ZINFOSledAgent (StorageMonitor): failed to notify nexus about a new pool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/b462a7f7-b628-40fe-80ff-4e4189e2d62b): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:270
2042023-12-19T22:59:06.665ZINFOSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:219
2052023-12-19T22:59:06.665ZINFOSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:219
2062023-12-19T22:59:06.665ZINFOSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:219
2072023-12-19T22:59:06.665ZINFOSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:219
2082023-12-19T22:59:06.665ZINFOSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: M2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:219
2092023-12-19T22:59:06.665ZINFOSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: M2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:219
2102023-12-19T22:59:06.666ZINFOSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:219
2112023-12-19T22:59:06.666ZINFOSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:219
2122023-12-19T22:59:06.666ZINFOSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:219
2132023-12-19T22:59:06.666ZINFOSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:219
2142023-12-19T22:59:06.666ZINFOSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/24b4dc87-ab46-49fb-a4b4-d361ae214c03): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:270
2152023-12-19T22:59:06.666ZINFOSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_31bd71cd-4736-4a12-a387-9b74b050396f on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/31bd71cd-4736-4a12-a387-9b74b050396f): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:270
2162023-12-19T22:59:06.666ZINFOSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/616b26df-e62a-4c68-b506-f4a923d8aaf7): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:270
2172023-12-19T22:59:06.666ZINFOSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/cd70d7f6-2354-4bf2-8012-55bf9eaf7930): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:270
2182023-12-19T22:59:06.667ZINFOSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/ceb4461c-cf56-4719-ad3c-14430bfdfb60): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:270
2192023-12-19T22:59:06.667ZINFOSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/d462a7f7-b628-40fe-80ff-4e4189e2d62b): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:270
2202023-12-19T22:59:06.667ZINFOSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/e4b4dc87-ab46-49fb-a4b4-d361ae214c03): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:270
2212023-12-19T22:59:06.667ZINFOSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/f4b4dc87-ab46-49fb-a4b4-d361ae214c03): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/storage_monitor.rs:270
2222023-12-19T22:59:08.923ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_switch
2232023-12-19T22:59:09.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 29.191938ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242023-12-19T22:59:09.221ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {}
2252023-12-19T22:59:09.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 118.832012ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262023-12-19T22:59:09.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 118.345454ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272023-12-19T22:59:09.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 286.798868ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282023-12-19T22:59:10.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 829.456747ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292023-12-19T22:59:11.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.379788651s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2302023-12-19T22:59:12.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.28036718s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2312023-12-19T22:59:14.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.442454224s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2322023-12-19T22:59:14.222ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {}
2332023-12-19T22:59:16.948ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:931 underlay_address = fd00:1122:3344:101::1
2342023-12-19T22:59:16.949ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
2352023-12-19T22:59:17.006ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:195 local_addr = [fd00:1122:3344:101::1]:12345
2362023-12-19T22:59:17.006ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:424
2372023-12-19T22:59:17.006ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2382023-12-19T22:59:17.006ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
2392023-12-19T22:59:17.006ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:198
2402023-12-19T22:59:17.007ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/sled_agent.rs:1076 retry_after = 312.178554ms sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2412023-12-19T22:59:17.007ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:198
2422023-12-19T22:59:17.007ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:137
2432023-12-19T22:59:17.007ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot file = sled-agent/src/hardware_monitor.rs:241 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:1::, prefix: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV1 { routes: [RouteConfig { destination: V4(Ipv4Network { addr: 0.0.0.0, prefix: 0 }), nexthop: 10.151.2.100 }], addresses: [V4(Ipv4Network { addr: 10.151.2.174, prefix: 32 })], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [] })))
2442023-12-19T22:59:17.007ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3037
2452023-12-19T22:59:17.007ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:a02a::1]:45575
2462023-12-19T22:59:17.010ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2472023-12-19T22:59:17.010ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2482023-12-19T22:59:17.010ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
2492023-12-19T22:59:17.010ZINFOSledAgent (RSS): No ledger in /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/rss-service-plan-v2.json file = common/src/ledger.rs:187
2502023-12-19T22:59:17.010ZINFOSledAgent (RSS): No ledger in /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/rss-service-plan-v2.json file = common/src/ledger.rs:187
2512023-12-19T22:59:17.010ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
2522023-12-19T22:59:17.011ZINFOSledAgent: failed to notify nexus about sled agent error = Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/sled_agent.rs:674 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2532023-12-19T22:59:17.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49713
2542023-12-19T22:59:17.044ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
2552023-12-19T22:59:17.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49713 req_id = 173c85c1-2244-44e4-bddd-c75ad6cf6ff2 response_code = 200 uri = /zpools
2562023-12-19T22:59:17.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46291
2572023-12-19T22:59:17.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46291 req_id = ef0beb9a-6995-4a7a-b6fa-bfb065c79271 response_code = 200 uri = /sled-role
2582023-12-19T22:59:17.076ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
2592023-12-19T22:59:17.076ZINFOSledAgent (RSS): Writing ledger to /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.rss-service-plan-v2.json.tmp file = common/src/ledger.rs:198
2602023-12-19T22:59:17.077ZINFOSledAgent (RSS): Writing ledger to /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.rss-service-plan-v2.json.tmp file = common/src/ledger.rs:198
2612023-12-19T22:59:17.077ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:749
2622023-12-19T22:59:17.100ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2632023-12-19T22:59:17.109ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 23f90f02-1967-4f0c-905f-8557297e61a6, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:299 sled_address = [fd00:1122:3344:101::1]:12345
2642023-12-19T22:59:17.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40770
2652023-12-19T22:59:17.110ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
2662023-12-19T22:59:17.110ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
2672023-12-19T22:59:17.161ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
2682023-12-19T22:59:17.161ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
2692023-12-19T22:59:17.209ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 23f90f02-1967-4f0c-905f-8557297e61a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
2702023-12-19T22:59:17.209ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 23f90f02-1967-4f0c-905f-8557297e61a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
2712023-12-19T22:59:17.212ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2722023-12-19T22:59:17.257ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
2732023-12-19T22:59:17.257ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/omicron-zones.json file = common/src/ledger.rs:187
2742023-12-19T22:59:17.257ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/omicron-zones.json file = common/src/ledger.rs:187
2752023-12-19T22:59:17.257ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
2762023-12-19T22:59:17.262ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
2772023-12-19T22:59:17.262ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
2782023-12-19T22:59:17.262ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
2792023-12-19T22:59:17.313ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4 file = illumos-utils/src/zone.rs:314
2802023-12-19T22:59:17.317ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487 file = illumos-utils/src/zone.rs:314
2812023-12-19T22:59:17.321ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6 file = illumos-utils/src/zone.rs:314
2822023-12-19T22:59:17.325ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/sled_agent.rs:1076 retry_after = 350.696264ms sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2832023-12-19T22:59:17.334ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4 file = illumos-utils/src/zone.rs:353
2842023-12-19T22:59:17.338ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487 file = illumos-utils/src/zone.rs:353
2852023-12-19T22:59:17.342ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6 file = illumos-utils/src/zone.rs:353
2862023-12-19T22:59:17.408ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2872023-12-19T22:59:17.652ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2882023-12-19T22:59:17.677ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/sled_agent.rs:1076 retry_after = 1.384407429s sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2892023-12-19T22:59:17.878ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2902023-12-19T22:59:18.166ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2912023-12-19T22:59:18.306ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:1711
2922023-12-19T22:59:18.444ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2932023-12-19T22:59:18.884ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2942023-12-19T22:59:19.037ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
2952023-12-19T22:59:19.064ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/sled_agent.rs:1076 retry_after = 1.220927301s sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
2962023-12-19T22:59:19.103ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4
2972023-12-19T22:59:19.122ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6
2982023-12-19T22:59:19.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487") failed: Property not found. retry in 56.552407ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
2992023-12-19T22:59:19.223ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {}
3002023-12-19T22:59:19.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4") failed: Property not found. retry in 49.834385ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4
3012023-12-19T22:59:19.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487") failed: Property not found. retry in 103.139491ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
3022023-12-19T22:59:19.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6") failed: Property not found. retry in 48.663651ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6
3032023-12-19T22:59:19.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4") failed: Property not found. retry in 94.943351ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4
3042023-12-19T22:59:19.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6") failed: Property not found. retry in 94.110344ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6
3052023-12-19T22:59:19.417ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
3062023-12-19T22:59:19.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487") failed: Property not found. retry in 106.92737ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
3072023-12-19T22:59:19.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6") failed: Property not found. retry in 286.803509ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6
3082023-12-19T22:59:19.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4") failed: Property not found. retry in 102.345165ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4
3092023-12-19T22:59:19.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487") failed: Property not found. retry in 295.369327ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
3102023-12-19T22:59:19.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4") failed: Property not found. retry in 569.899416ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4
3112023-12-19T22:59:19.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6") failed: Property not found. retry in 527.730877ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6
3122023-12-19T22:59:19.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487") failed: Property not found. retry in 799.853374ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
3132023-12-19T22:59:20.131ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
3142023-12-19T22:59:20.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4") failed: Property not found. retry in 893.409277ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4
3152023-12-19T22:59:20.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6") failed: Property not found. retry in 1.177897523s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6
3162023-12-19T22:59:20.287ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: proto error: io error: No route to host (os error 148)" file = sled-agent/src/sled_agent.rs:1076 retry_after = 5.622176097s sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
3172023-12-19T22:59:20.642ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
3182023-12-19T22:59:20.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487") failed: Property not found. retry in 632.159352ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
3192023-12-19T22:59:21.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4") failed: Property not found. retry in 656.876578ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4
3202023-12-19T22:59:21.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487") failed: Property not found. retry in 926.161929ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
3212023-12-19T22:59:21.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6") failed: Property not found. retry in 1.180675965s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6
3222023-12-19T22:59:21.642ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
3232023-12-19T22:59:21.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4") failed: Property not found. retry in 1.443259829s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4
3242023-12-19T22:59:22.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487") failed: Property not found. retry in 638.474761ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
3252023-12-19T22:59:22.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6") failed: Property not found. retry in 956.46146ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6
3262023-12-19T22:59:22.714ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
3272023-12-19T22:59:22.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487") failed: Property not found. retry in 671.708457ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
3282023-12-19T22:59:23.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4") failed: Property not found. retry in 868.693295ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4
3292023-12-19T22:59:23.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487") failed: Property not found. retry in 527.902852ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
3302023-12-19T22:59:23.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6") failed: Property not found. retry in 1.223175454s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6
3312023-12-19T22:59:24.112ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:1::1 exists file = sled-agent/src/services.rs:1764
3322023-12-19T22:59:24.112ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:1::1, prefix: 64 })) file = illumos-utils/src/running_zone.rs:608 zone = oxz_internal_dns_1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4
3332023-12-19T22:59:24.359ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:a02a::2 exists in switch zone file = sled-agent/src/services.rs:1728
3342023-12-19T22:59:24.359ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:625 zone = oxz_switch
3352023-12-19T22:59:24.671ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:1::1 exists - OK file = sled-agent/src/services.rs:1772
3362023-12-19T22:59:24.671ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:1796
3372023-12-19T22:59:24.912ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fef1:9fec file = sled-agent/src/services.rs:1735
3382023-12-19T22:59:24.918ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:1796
3392023-12-19T22:59:25.040ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2275
3402023-12-19T22:59:25.285ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2154
3412023-12-19T22:59:25.572ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2189
3422023-12-19T22:59:25.623ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
3432023-12-19T22:59:25.626ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {}
3442023-12-19T22:59:25.676ZINFOSledAgent (ServiceManager): Setting up internal-dns service file = sled-agent/src/services.rs:1990
3452023-12-19T22:59:25.765ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2456
3462023-12-19T22:59:25.908ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2461
3472023-12-19T22:59:26.088ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2395
3482023-12-19T22:59:26.255ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2183
3492023-12-19T22:59:26.264ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
3502023-12-19T22:59:26.267ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3289 new = [fd00:1122:3344:101::2, ::1] old = [::1]
3512023-12-19T22:59:26.268ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3305
3522023-12-19T22:59:26.268ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:608 zone = oxz_switch
3532023-12-19T22:59:26.287ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:2::1 exists file = sled-agent/src/services.rs:1764
3542023-12-19T22:59:26.287ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:2::1, prefix: 64 })) file = illumos-utils/src/running_zone.rs:608 zone = oxz_internal_dns_18eb7385-4ed5-41f8-9b37-97eb0466d487
3552023-12-19T22:59:26.673ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: dns error: no record found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = sled-agent/src/sled_agent.rs:1076 retry_after = 4.66175412s sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
3562023-12-19T22:59:26.815ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3313
3572023-12-19T22:59:26.821ZINFOSledAgent (ServiceManager): configuring dendrite zone file = sled-agent/src/services.rs:3369
3582023-12-19T22:59:26.834ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:2::1 exists - OK file = sled-agent/src/services.rs:1772
3592023-12-19T22:59:26.834ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:1796
3602023-12-19T22:59:27.002ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:3409 rack_subnet = fd00:1122:3344::
3612023-12-19T22:59:27.054ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:359
3622023-12-19T22:59:27.087ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 60.849669ms) error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "b1da0de3-27c2-49f9-9d0c-e9b38e84080c", "content-length": "152", "date": "Tue, 19 Dec 2023 22:59:26 GMT"}; value: Error { error_code: Some("DiscoveryNotYetComplete"), message: "discovery process not yet complete", request_id: "b1da0de3-27c2-49f9-9d0c-e9b38e84080c" } file = sled-agent/src/bootstrap/early_networking.rs:378
3632023-12-19T22:59:27.148ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 94.483742ms) error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "a4504340-c133-406f-85a2-6a52ddd1a532", "content-length": "152", "date": "Tue, 19 Dec 2023 22:59:26 GMT"}; value: Error { error_code: Some("DiscoveryNotYetComplete"), message: "discovery process not yet complete", request_id: "a4504340-c133-406f-85a2-6a52ddd1a532" } file = sled-agent/src/bootstrap/early_networking.rs:378
3642023-12-19T22:59:27.244ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 254.707611ms) error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "f4542236-e471-4773-9c4b-9b5987491945", "content-length": "152", "date": "Tue, 19 Dec 2023 22:59:26 GMT"}; value: Error { error_code: Some("DiscoveryNotYetComplete"), message: "discovery process not yet complete", request_id: "f4542236-e471-4773-9c4b-9b5987491945" } file = sled-agent/src/bootstrap/early_networking.rs:378
3652023-12-19T22:59:27.360ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
3662023-12-19T22:59:27.501ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:407
3672023-12-19T22:59:27.532ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:558
3682023-12-19T22:59:27.532ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:627
3692023-12-19T22:59:27.532ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:630 uptime = 2
3702023-12-19T22:59:27.532ZINFOSledAgent (ServiceManager): Configuring boundary services loopback address on switch config = Ipv6Entry {\n addr: fd00:99::1,\n tag: "omicron",\n} file = sled-agent/src/bootstrap/early_networking.rs:429
3712023-12-19T22:59:27.532ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n v4_routes: {\n "0.0.0.0/0": [\n RouteSettingsV4 {\n link_id: 0,\n nexthop: 10.151.2.100,\n },\n ],\n },\n v6_routes: {},\n} file = sled-agent/src/bootstrap/early_networking.rs:440
3722023-12-19T22:59:27.533ZINFOSledAgent (ServiceManager): advertising boundary services loopback address file = sled-agent/src/bootstrap/early_networking.rs:457
3732023-12-19T22:59:27.592ZINFOSledAgent (ServiceManager): Setting up internal-dns service file = sled-agent/src/services.rs:1990
3742023-12-19T22:59:27.606ZINFOSledAgent (ServiceManager): Sending prefix to ddmd for advertisement DdmAdminClient = [fd00:1122:3344:101::2]:8000 file = clients/ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fd00:99::, len: 64 }
3752023-12-19T22:59:27.652ZINFOSledAgent (StorageManager): Received DisksChanged({}) file = sled-storage/src/manager.rs:346
3762023-12-19T22:59:28.186ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:3::1 exists file = sled-agent/src/services.rs:1764
3772023-12-19T22:59:28.187ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:3::1, prefix: 64 })) file = illumos-utils/src/running_zone.rs:608 zone = oxz_internal_dns_23f90f02-1967-4f0c-905f-8557297e61a6
3782023-12-19T22:59:28.733ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:3::1 exists - OK file = sled-agent/src/services.rs:1772
3792023-12-19T22:59:28.734ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:1796
3802023-12-19T22:59:29.514ZINFOSledAgent (ServiceManager): Setting up internal-dns service file = sled-agent/src/services.rs:1990
3812023-12-19T22:59:29.552ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
3822023-12-19T22:59:29.993ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
3832023-12-19T22:59:30.085ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:198
3842023-12-19T22:59:30.086ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
3852023-12-19T22:59:30.086ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:198
3862023-12-19T22:59:30.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 12976886 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40770 req_id = 58bdabde-5b2b-40b6-a5f7-e62bfd0157ed response_code = 204 uri = /omicron-zones
3872023-12-19T22:59:30.088ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:417
3882023-12-19T22:59:30.187ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:417
3892023-12-19T22:59:30.259ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:417
3902023-12-19T22:59:30.628ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
3912023-12-19T22:59:30.857ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37535
3922023-12-19T22:59:30.857ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37535 req_id = 14829523-53f4-4cae-8b91-e7a98db857f0 response_code = 200 uri = /baseboard
3932023-12-19T22:59:31.463ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:453
3942023-12-19T22:59:31.463ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:253
3952023-12-19T22:59:31.495ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:270
3962023-12-19T22:59:31.496ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:295
3972023-12-19T22:59:31.496ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:187
3982023-12-19T22:59:31.525ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 23f90f02-1967-4f0c-905f-8557297e61a6, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5e413d38-1439-408f-bda4-4b126836d8ce, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2fbf419f-560d-4d2a-bc7b-51ae27d7bd34, kind: Service { id: 5e413d38-1439-408f-bda4-4b126836d8ce }, name: Name("ntp-5e413d38-1439-408f-bda4-4b126836d8ce"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:299 sled_address = [fd00:1122:3344:101::1]:12345
3992023-12-19T22:59:31.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54594
4002023-12-19T22:59:31.526ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
4012023-12-19T22:59:31.526ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
4022023-12-19T22:59:31.548ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
4032023-12-19T22:59:31.548ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
4042023-12-19T22:59:31.566ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 23f90f02-1967-4f0c-905f-8557297e61a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
4052023-12-19T22:59:31.566ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 23f90f02-1967-4f0c-905f-8557297e61a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
4062023-12-19T22:59:31.586ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
4072023-12-19T22:59:31.586ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/omicron-zones.json file = common/src/ledger.rs:176
4082023-12-19T22:59:31.586ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/omicron-zones.json file = common/src/ledger.rs:176
4092023-12-19T22:59:31.586ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
4102023-12-19T22:59:31.588ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:253
4112023-12-19T22:59:31.620ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:270
4122023-12-19T22:59:31.621ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:295
4132023-12-19T22:59:31.621ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:187
4142023-12-19T22:59:31.665ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:396 port = Port { inner: PortInner { name: "opte0", _ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 247, 182]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
4152023-12-19T22:59:31.665ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1221 zone_type = ntp
4162023-12-19T22:59:31.666ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:98
4172023-12-19T22:59:31.666ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:105
4182023-12-19T22:59:31.666ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:133
4192023-12-19T22:59:31.668ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
4202023-12-19T22:59:31.693ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce file = illumos-utils/src/zone.rs:314
4212023-12-19T22:59:31.712ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce file = illumos-utils/src/zone.rs:353
4222023-12-19T22:59:32.805ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4232023-12-19T22:59:32.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce") failed: Property not found. retry in 47.462159ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4242023-12-19T22:59:32.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce") failed: Property not found. retry in 98.764354ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4252023-12-19T22:59:33.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce") failed: Property not found. retry in 142.611617ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4262023-12-19T22:59:33.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce") failed: Property not found. retry in 398.362837ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4272023-12-19T22:59:33.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce") failed: Property not found. retry in 888.121788ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4282023-12-19T22:59:34.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce") failed: Property not found. retry in 531.602191ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4292023-12-19T22:59:35.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce") failed: Property not found. retry in 956.089176ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4302023-12-19T22:59:35.629ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
4312023-12-19T22:59:35.880ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037 sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
4322023-12-19T22:59:36.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce") failed: Property not found. retry in 1.496360223s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4332023-12-19T22:59:37.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce") failed: Property not found. retry in 557.538873ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4342023-12-19T22:59:38.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce") failed: Property not found. retry in 1.042983515s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4352023-12-19T22:59:39.245ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::1b exists file = sled-agent/src/services.rs:1764
4362023-12-19T22:59:39.245ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::1b, prefix: 64 })) file = illumos-utils/src/running_zone.rs:608 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4372023-12-19T22:59:39.792ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::1b exists - OK file = sled-agent/src/services.rs:1772
4382023-12-19T22:59:39.792ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1791
4392023-12-19T22:59:40.475ZINFOSledAgent (ServiceManager): Set up NTP service boundary=true, Servers=["0.pool.ntp.org"] file = sled-agent/src/services.rs:2081
4402023-12-19T22:59:40.536ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:652 zone = oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce
4412023-12-19T22:59:45.819ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
4422023-12-19T22:59:45.877ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:198
4432023-12-19T22:59:45.877ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:198
4442023-12-19T22:59:45.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 14351934 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54594 req_id = a46a857f-47d4-4b00-a177-904d9d85422d response_code = 204 uri = /omicron-zones
4452023-12-19T22:59:45.880ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:494
4462023-12-19T22:59:45.911ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
4472023-12-19T22:59:45.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36716
4482023-12-19T22:59:45.920ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5e413d38-1439-408f-bda4-4b126836d8ce': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3023
4492023-12-19T22:59:45.920ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:841 latency_us = 8900 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36716 req_id = fb9aa73d-2d8f-49a8-880b-c976b687e247 response_code = 500 uri = /timesync
4502023-12-19T22:59:45.923ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
4512023-12-19T22:59:46.044ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
4522023-12-19T22:59:46.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38808
4532023-12-19T22:59:46.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 7974 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38808 req_id = 76ee9847-6548-41a0-8714-6368860c3b8f response_code = 200 uri = /timesync
4542023-12-19T22:59:46.054ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
4552023-12-19T22:59:46.054ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
4562023-12-19T22:59:46.261ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
4572023-12-19T22:59:46.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36960
4582023-12-19T22:59:46.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8466 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36960 req_id = 48ef139c-68da-437c-a79f-a61e7bdd349d response_code = 200 uri = /timesync
4592023-12-19T22:59:46.273ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
4602023-12-19T22:59:46.273ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
4612023-12-19T22:59:46.450ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
4622023-12-19T22:59:46.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61974
4632023-12-19T22:59:46.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 6971 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61974 req_id = 173672bf-3f23-4d0a-a662-8c792b6e4a5d response_code = 200 uri = /timesync
4642023-12-19T22:59:46.461ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
4652023-12-19T22:59:46.461ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
4662023-12-19T22:59:46.732ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
4672023-12-19T22:59:46.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60472
4682023-12-19T22:59:46.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8068 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60472 req_id = ec8a0ebc-1886-4544-a387-e444175e8f0b response_code = 200 uri = /timesync
4692023-12-19T22:59:46.743ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
4702023-12-19T22:59:46.743ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
4712023-12-19T22:59:47.048ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
4722023-12-19T22:59:47.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61412
4732023-12-19T22:59:47.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 7260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61412 req_id = deda127f-d3a9-4ac2-a4e4-e537a5933940 response_code = 200 uri = /timesync
4742023-12-19T22:59:47.060ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
4752023-12-19T22:59:47.060ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
4762023-12-19T22:59:47.454ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
4772023-12-19T22:59:47.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51224
4782023-12-19T22:59:47.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8574 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51224 req_id = 534440de-2f4c-4f0a-ad40-c4450e76f75b response_code = 200 uri = /timesync
4792023-12-19T22:59:47.464ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
4802023-12-19T22:59:47.464ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
4812023-12-19T22:59:47.729ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
4822023-12-19T22:59:47.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63749
4832023-12-19T22:59:47.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 7593 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63749 req_id = c8d20794-fe09-4eb5-af3e-2b22bcce09ec response_code = 200 uri = /timesync
4842023-12-19T22:59:47.740ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
4852023-12-19T22:59:47.740ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
4862023-12-19T22:59:48.016ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
4872023-12-19T22:59:48.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38796
4882023-12-19T22:59:48.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 9272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38796 req_id = d568c488-bfb6-4563-9156-476fee8ed7f5 response_code = 200 uri = /timesync
4892023-12-19T22:59:48.028ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
4902023-12-19T22:59:48.028ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
4912023-12-19T22:59:48.462ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
4922023-12-19T22:59:48.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58659
4932023-12-19T22:59:48.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8530 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58659 req_id = 7d170df5-c17d-4766-8184-b3b8c0c4ee3b response_code = 200 uri = /timesync
4942023-12-19T22:59:48.473ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
4952023-12-19T22:59:48.473ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
4962023-12-19T22:59:48.881ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
4972023-12-19T22:59:48.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47224
4982023-12-19T22:59:48.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 7804 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47224 req_id = 1d6c9693-8919-46e6-b1ca-9ce2e2e7e1a1 response_code = 200 uri = /timesync
4992023-12-19T22:59:48.893ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
5002023-12-19T22:59:48.893ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5012023-12-19T22:59:49.333ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5022023-12-19T22:59:49.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62076
5032023-12-19T22:59:49.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 7946 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62076 req_id = 78db64f8-bfa7-4660-8ba1-a85599a67e36 response_code = 200 uri = /timesync
5042023-12-19T22:59:49.343ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
5052023-12-19T22:59:49.343ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5062023-12-19T22:59:50.347ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5072023-12-19T22:59:50.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52409
5082023-12-19T22:59:50.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 7834 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52409 req_id = 14892ec8-7fc0-4749-ba01-83b4083b06b2 response_code = 200 uri = /timesync
5092023-12-19T22:59:50.359ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:502
5102023-12-19T22:59:50.359ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5112023-12-19T22:59:50.820ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5122023-12-19T22:59:51.158ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5132023-12-19T22:59:51.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62348
5142023-12-19T22:59:51.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62348 req_id = 66230982-7b24-4496-93f5-7d0aec01d3b5 response_code = 200 uri = /timesync
5152023-12-19T22:59:51.170ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.097237885 } file = sled-agent/src/rack_setup/service.rs:502
5162023-12-19T22:59:51.170ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5172023-12-19T22:59:52.512ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5182023-12-19T22:59:52.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61215
5192023-12-19T22:59:52.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8510 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61215 req_id = 67c14bcf-35dd-494c-8e7d-56be7d721bf2 response_code = 200 uri = /timesync
5202023-12-19T22:59:52.524ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.093561009 } file = sled-agent/src/rack_setup/service.rs:502
5212023-12-19T22:59:52.524ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5222023-12-19T22:59:53.383ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5232023-12-19T22:59:53.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48516
5242023-12-19T22:59:53.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48516 req_id = 1846b87d-7522-41e4-9904-0b98a6f8de78 response_code = 200 uri = /timesync
5252023-12-19T22:59:53.394ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.092381418 } file = sled-agent/src/rack_setup/service.rs:502
5262023-12-19T22:59:53.394ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5272023-12-19T22:59:55.097ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5282023-12-19T22:59:55.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54929
5292023-12-19T22:59:55.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8063 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54929 req_id = d4caa6df-3a93-49e0-8a6d-119cc4b1bd94 response_code = 200 uri = /timesync
5302023-12-19T22:59:55.108ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.087725922 } file = sled-agent/src/rack_setup/service.rs:502
5312023-12-19T22:59:55.108ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5322023-12-19T22:59:55.811ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5332023-12-19T22:59:57.045ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5342023-12-19T22:59:57.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57310
5352023-12-19T22:59:57.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 9885 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57310 req_id = 3d9a09c8-9975-49ef-9d29-f83d2d8aaf6a response_code = 200 uri = /timesync
5362023-12-19T22:59:57.057ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.082430631 } file = sled-agent/src/rack_setup/service.rs:502
5372023-12-19T22:59:57.057ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5382023-12-19T23:00:00.328ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5392023-12-19T23:00:00.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60856
5402023-12-19T23:00:00.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8873 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60856 req_id = 0ef178d9-d33b-4aa8-a045-0bdde4bdb9c9 response_code = 200 uri = /timesync
5412023-12-19T23:00:00.340ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.073518075 } file = sled-agent/src/rack_setup/service.rs:502
5422023-12-19T23:00:00.340ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5432023-12-19T23:00:00.800ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5442023-12-19T23:00:00.866ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39293
5452023-12-19T23:00:00.866ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39293 req_id = d71a592d-2492-4cc3-9f05-da02f9cabc40 response_code = 200 uri = /baseboard
5462023-12-19T23:00:02.836ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5472023-12-19T23:00:02.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60488
5482023-12-19T23:00:02.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60488 req_id = 5325bfb7-0662-43f4-ae50-c4c7f6d3d301 response_code = 200 uri = /timesync
5492023-12-19T23:00:02.847ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.06670814 } file = sled-agent/src/rack_setup/service.rs:502
5502023-12-19T23:00:02.847ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5512023-12-19T23:00:05.089ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5522023-12-19T23:00:05.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43249
5532023-12-19T23:00:05.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 7987 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43249 req_id = 93176ba0-a2b9-47d4-80d5-293521bb5085 response_code = 200 uri = /timesync
5542023-12-19T23:00:05.099ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.060591388 } file = sled-agent/src/rack_setup/service.rs:502
5552023-12-19T23:00:05.099ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5562023-12-19T23:00:05.788ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5572023-12-19T23:00:10.775ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5582023-12-19T23:00:10.835ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5592023-12-19T23:00:10.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37254
5602023-12-19T23:00:10.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8692 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37254 req_id = 1f54dc3a-ef04-410a-944a-479f2845f5d3 response_code = 200 uri = /timesync
5612023-12-19T23:00:10.846ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.044984341 } file = sled-agent/src/rack_setup/service.rs:502
5622023-12-19T23:00:10.846ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5632023-12-19T23:00:14.917ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5642023-12-19T23:00:14.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40299
5652023-12-19T23:00:14.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 9775 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40299 req_id = 6a57a90f-50f7-4a1a-884e-d798f47ff132 response_code = 200 uri = /timesync
5662023-12-19T23:00:14.929ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.033896197 } file = sled-agent/src/rack_setup/service.rs:502
5672023-12-19T23:00:14.930ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5682023-12-19T23:00:15.763ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5692023-12-19T23:00:17.748ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5702023-12-19T23:00:17.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55736
5712023-12-19T23:00:17.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 9016 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55736 req_id = e61c3204-2ce3-426f-b07a-e34b76ce5b95 response_code = 200 uri = /timesync
5722023-12-19T23:00:17.761ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.02620854 } file = sled-agent/src/rack_setup/service.rs:502
5732023-12-19T23:00:17.761ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5742023-12-19T23:00:20.751ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5752023-12-19T23:00:22.193ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5762023-12-19T23:00:22.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58229
5772023-12-19T23:00:22.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8903 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58229 req_id = 660b28f4-e774-43a5-b4ee-a15ac6fc8b61 response_code = 200 uri = /timesync
5782023-12-19T23:00:22.204ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: -0.014138873 } file = sled-agent/src/rack_setup/service.rs:502
5792023-12-19T23:00:22.204ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5802023-12-19T23:00:25.739ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5812023-12-19T23:00:30.735ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5822023-12-19T23:00:30.826ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62312
5832023-12-19T23:00:30.826ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62312 req_id = 062d0c31-c299-4d20-a29b-2d43cb6a6f50 response_code = 200 uri = /baseboard
5842023-12-19T23:00:31.943ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5852023-12-19T23:00:31.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62581
5862023-12-19T23:00:31.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 9465 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62581 req_id = 8efdd5fd-9873-4a84-bb85-1720fa118c31 response_code = 200 uri = /timesync
5872023-12-19T23:00:31.955ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 2.616e-6 } file = sled-agent/src/rack_setup/service.rs:502
5882023-12-19T23:00:31.955ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5892023-12-19T23:00:35.736ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5902023-12-19T23:00:40.738ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5912023-12-19T23:00:45.739ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5922023-12-19T23:00:45.969ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5932023-12-19T23:00:45.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56429
5942023-12-19T23:00:45.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 9236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56429 req_id = 4c32ed61-4859-4d74-8ff1-a4841a4fd394 response_code = 200 uri = /timesync
5952023-12-19T23:00:45.981ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026784.2044115, correction: 2.486e-6 } file = sled-agent/src/rack_setup/service.rs:502
5962023-12-19T23:00:45.981ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
5972023-12-19T23:00:50.741ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5982023-12-19T23:00:53.626ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
5992023-12-19T23:00:53.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54192
6002023-12-19T23:00:53.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 8599 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54192 req_id = ab8d23b5-3b84-418c-a112-c1f100b9ce75 response_code = 200 uri = /timesync
6012023-12-19T23:00:53.638ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1703026852.2748678, correction: 2.416e-6 } file = sled-agent/src/rack_setup/service.rs:502
6022023-12-19T23:00:53.639ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:524
6032023-12-19T23:00:55.742ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6042023-12-19T23:01:00.744ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6052023-12-19T23:01:00.860ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64619
6062023-12-19T23:01:00.861ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1015 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64619 req_id = d767de53-5818-4be7-9ebb-53335d3d73ad response_code = 200 uri = /baseboard
6072023-12-19T23:01:05.746ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6082023-12-19T23:01:07.826ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:474
6092023-12-19T23:01:07.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55989
6102023-12-19T23:01:07.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 22349 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55989 req_id = 379a0623-2d29-40d3-875b-b8f647178f63 response_code = 200 uri = /timesync
6112023-12-19T23:01:07.850ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1703026856.767709, correction: 0.001349129 } file = sled-agent/src/rack_setup/service.rs:502
6122023-12-19T23:01:07.850ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1042
6132023-12-19T23:01:07.880ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 23f90f02-1967-4f0c-905f-8557297e61a6, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5e413d38-1439-408f-bda4-4b126836d8ce, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2fbf419f-560d-4d2a-bc7b-51ae27d7bd34, kind: Service { id: 5e413d38-1439-408f-bda4-4b126836d8ce }, name: Name("ntp-5e413d38-1439-408f-bda4-4b126836d8ce"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 27b27166-2734-4409-b6d8-9557b3956118, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } } } }, OmicronZoneConfig { id: b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } } } }, OmicronZoneConfig { id: a2b50530-cea8-44ca-9039-1c21722dae22, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External } } } }, OmicronZoneConfig { id: 8661716b-9deb-496e-a80f-9e7183d7d40c, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External } } } }, OmicronZoneConfig { id: d1bf2dad-cfa5-403e-a7fc-29d6ef199701, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:299 sled_address = [fd00:1122:3344:101::1]:12345
6142023-12-19T23:01:07.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51376
6152023-12-19T23:01:07.880ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
6162023-12-19T23:01:07.880ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
6172023-12-19T23:01:07.899ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
6182023-12-19T23:01:07.901ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
6192023-12-19T23:01:07.917ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 23f90f02-1967-4f0c-905f-8557297e61a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
6202023-12-19T23:01:07.919ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 23f90f02-1967-4f0c-905f-8557297e61a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
6212023-12-19T23:01:07.934ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 27b27166-2734-4409-b6d8-9557b3956118, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
6222023-12-19T23:01:07.934ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 27b27166-2734-4409-b6d8-9557b3956118, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
6232023-12-19T23:01:07.995ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
6242023-12-19T23:01:07.995ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
6252023-12-19T23:01:08.051ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a2b50530-cea8-44ca-9039-1c21722dae22, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
6262023-12-19T23:01:08.051ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a2b50530-cea8-44ca-9039-1c21722dae22, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
6272023-12-19T23:01:08.115ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8661716b-9deb-496e-a80f-9e7183d7d40c, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
6282023-12-19T23:01:08.115ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 8661716b-9deb-496e-a80f-9e7183d7d40c, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
6292023-12-19T23:01:08.170ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d1bf2dad-cfa5-403e-a7fc-29d6ef199701, dataset_name: DatasetName { pool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
6302023-12-19T23:01:08.170ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: d1bf2dad-cfa5-403e-a7fc-29d6ef199701, dataset_name: DatasetName { pool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
6312023-12-19T23:01:08.229ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
6322023-12-19T23:01:08.229ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/omicron-zones.json file = common/src/ledger.rs:176
6332023-12-19T23:01:08.229ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/omicron-zones.json file = common/src/ledger.rs:176
6342023-12-19T23:01:08.229ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
6352023-12-19T23:01:08.236ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
6362023-12-19T23:01:08.236ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
6372023-12-19T23:01:08.236ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
6382023-12-19T23:01:08.236ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
6392023-12-19T23:01:08.236ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
6402023-12-19T23:01:08.325ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4 file = illumos-utils/src/zone.rs:314
6412023-12-19T23:01:08.329ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c file = illumos-utils/src/zone.rs:314
6422023-12-19T23:01:08.333ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701 file = illumos-utils/src/zone.rs:314
6432023-12-19T23:01:08.337ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22 file = illumos-utils/src/zone.rs:314
6442023-12-19T23:01:08.342ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118 file = illumos-utils/src/zone.rs:314
6452023-12-19T23:01:08.347ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4 file = illumos-utils/src/zone.rs:353
6462023-12-19T23:01:08.351ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c file = illumos-utils/src/zone.rs:353
6472023-12-19T23:01:08.355ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701 file = illumos-utils/src/zone.rs:353
6482023-12-19T23:01:08.359ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22 file = illumos-utils/src/zone.rs:353
6492023-12-19T23:01:08.364ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118 file = illumos-utils/src/zone.rs:353
6502023-12-19T23:01:10.748ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6512023-12-19T23:01:12.095ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::3"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6522023-12-19T23:01:12.095ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
6532023-12-19T23:01:12.104ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::7"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6542023-12-19T23:01:12.104ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
6552023-12-19T23:01:12.129ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::5"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6562023-12-19T23:01:12.129ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
6572023-12-19T23:01:12.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 35.497423ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
6582023-12-19T23:01:12.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 25.408027ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
6592023-12-19T23:01:12.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 50.094727ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
6602023-12-19T23:01:12.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 124.562988ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
6612023-12-19T23:01:12.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 139.085625ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
6622023-12-19T23:01:12.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 148.903807ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
6632023-12-19T23:01:12.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 273.135453ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
6642023-12-19T23:01:12.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 161.320983ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
6652023-12-19T23:01:12.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 154.015447ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
6662023-12-19T23:01:12.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 524.792294ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
6672023-12-19T23:01:13.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 567.389034ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
6682023-12-19T23:01:13.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 474.979323ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
6692023-12-19T23:01:13.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 1.162725979s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
6702023-12-19T23:01:13.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 851.486959ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
6712023-12-19T23:01:13.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 977.988616ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
6722023-12-19T23:01:14.325ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::4"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6732023-12-19T23:01:14.325ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4
6742023-12-19T23:01:14.391ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::6"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6752023-12-19T23:01:14.391ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c
6762023-12-19T23:01:14.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4") failed: Property not found. retry in 32.650087ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4
6772023-12-19T23:01:14.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 1.361101246s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
6782023-12-19T23:01:14.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4") failed: Property not found. retry in 68.593529ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4
6792023-12-19T23:01:14.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c") failed: Property not found. retry in 54.494083ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c
6802023-12-19T23:01:14.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c") failed: Property not found. retry in 119.161128ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c
6812023-12-19T23:01:14.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4") failed: Property not found. retry in 278.922556ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4
6822023-12-19T23:01:14.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 1.368043797s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
6832023-12-19T23:01:14.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c") failed: Property not found. retry in 216.108589ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c
6842023-12-19T23:01:14.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 1.239897974s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
6852023-12-19T23:01:14.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4") failed: Property not found. retry in 316.415414ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4
6862023-12-19T23:01:14.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c") failed: Property not found. retry in 301.175142ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c
6872023-12-19T23:01:15.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4") failed: Property not found. retry in 1.091163456s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4
6882023-12-19T23:01:15.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c") failed: Property not found. retry in 666.791445ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c
6892023-12-19T23:01:15.750ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6902023-12-19T23:01:15.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 553.108516ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
6912023-12-19T23:01:15.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c") failed: Property not found. retry in 891.362196ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c
6922023-12-19T23:01:16.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 719.355936ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
6932023-12-19T23:01:16.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 1.293167843s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
6942023-12-19T23:01:16.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4") failed: Property not found. retry in 1.270987294s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4
6952023-12-19T23:01:16.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 581.529847ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
6962023-12-19T23:01:16.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 1.085764622s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
6972023-12-19T23:01:16.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c") failed: Property not found. retry in 878.432131ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c
6982023-12-19T23:01:17.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 530.129322ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
6992023-12-19T23:01:17.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 1.474500755s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7002023-12-19T23:01:17.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 1.41631453s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7012023-12-19T23:01:17.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4") failed: Property not found. retry in 1.476558933s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4
7022023-12-19T23:01:17.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c") failed: Property not found. retry in 1.229557101s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c
7032023-12-19T23:01:17.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 1.148100959s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
7042023-12-19T23:01:18.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 579.587568ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7052023-12-19T23:01:18.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c") failed: Property not found. retry in 696.526039ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8661716b-9deb-496e-a80f-9e7183d7d40c
7062023-12-19T23:01:18.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 1.351840731s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7072023-12-19T23:01:18.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 1.12299015s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
7082023-12-19T23:01:19.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4") failed: Property not found. retry in 1.022982994s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4
7092023-12-19T23:01:19.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 1.366759786s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7102023-12-19T23:01:20.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 1.261881085s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
7112023-12-19T23:01:20.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 538.818729ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7122023-12-19T23:01:20.752ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7132023-12-19T23:01:20.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 694.776323ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7142023-12-19T23:01:20.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 532.247825ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7152023-12-19T23:01:21.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 800.675509ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
7162023-12-19T23:01:21.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 1.492131517s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7172023-12-19T23:01:21.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 1.374226242s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7182023-12-19T23:01:22.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 955.416971ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
7192023-12-19T23:01:22.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 1.053540807s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7202023-12-19T23:01:22.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 1.257608477s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7212023-12-19T23:01:23.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 625.636987ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
7222023-12-19T23:01:23.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 1.440088505s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
7232023-12-19T23:01:23.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 1.438388584s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7242023-12-19T23:01:24.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 1.029408803s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7252023-12-19T23:01:25.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 574.217991ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7262023-12-19T23:01:25.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 1.361495122s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
7272023-12-19T23:01:25.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 559.832191ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7282023-12-19T23:01:25.754ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7292023-12-19T23:01:25.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 557.299394ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7302023-12-19T23:01:25.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 988.064486ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7312023-12-19T23:01:26.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 1.354048105s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7322023-12-19T23:01:26.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 1.372003419s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
7332023-12-19T23:01:26.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 775.024534ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7342023-12-19T23:01:27.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 694.059905ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7352023-12-19T23:01:27.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 726.104046ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7362023-12-19T23:01:28.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 1.141342867s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
7372023-12-19T23:01:28.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 939.858032ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7382023-12-19T23:01:28.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22") failed: Property not found. retry in 1.096854309s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a2b50530-cea8-44ca-9039-1c21722dae22
7392023-12-19T23:01:29.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118") failed: Property not found. retry in 1.406922499s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_27b27166-2734-4409-b6d8-9557b3956118
7402023-12-19T23:01:29.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701") failed: Property not found. retry in 1.467608118s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d1bf2dad-cfa5-403e-a7fc-29d6ef199701
7412023-12-19T23:01:30.756ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7422023-12-19T23:01:30.878ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:198
7432023-12-19T23:01:30.878ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:198
7442023-12-19T23:01:30.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 22998294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51376 req_id = 4a9bdfc7-ca84-41c7-8b2f-d8cc1bf83042 response_code = 204 uri = /omicron-zones
7452023-12-19T23:01:30.895ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44679
7462023-12-19T23:01:30.895ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44679 req_id = a8123ef5-edba-47e4-a93f-ef34a4c6228a response_code = 200 uri = /baseboard
7472023-12-19T23:01:30.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47334
7482023-12-19T23:01:30.942ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:2876
7492023-12-19T23:01:35.358ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:2894
7502023-12-19T23:01:37.857ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:2915
7512023-12-19T23:01:37.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 6945154 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47334 req_id = 0f61e8b4-1f75-48c8-a104-c64fb4f28922 response_code = 204 uri = /cockroachdb
7522023-12-19T23:01:37.858ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7532023-12-19T23:01:37.907ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 23f90f02-1967-4f0c-905f-8557297e61a6, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5e413d38-1439-408f-bda4-4b126836d8ce, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2fbf419f-560d-4d2a-bc7b-51ae27d7bd34, kind: Service { id: 5e413d38-1439-408f-bda4-4b126836d8ce }, name: Name("ntp-5e413d38-1439-408f-bda4-4b126836d8ce"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 27b27166-2734-4409-b6d8-9557b3956118, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } } } }, OmicronZoneConfig { id: b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } } } }, OmicronZoneConfig { id: a2b50530-cea8-44ca-9039-1c21722dae22, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External } } } }, OmicronZoneConfig { id: 8661716b-9deb-496e-a80f-9e7183d7d40c, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External } } } }, OmicronZoneConfig { id: d1bf2dad-cfa5-403e-a7fc-29d6ef199701, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External } } } }, OmicronZoneConfig { id: 93d69613-245d-4c9d-bfae-666f10c736c7, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 70d944ff-b091-4f45-a71a-1735c343e70a, kind: Service { id: 93d69613-245d-4c9d-bfae-666f10c736c7 }, name: Name("external-dns-93d69613-245d-4c9d-bfae-666f10c736c7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 134])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 5d97d1ac-59e1-4ee6-8a5a-49d048efbba6, kind: Service { id: d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e }, name: Name("external-dns-d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 102])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: 84fda2b6-423e-4cf4-9244-a7408c62a861, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 50985ea0-d0b9-4e0a-ac85-ca7e868331f5, kind: Service { id: 84fda2b6-423e-4cf4-9244-a7408c62a861 }, name: Name("nexus-84fda2b6-423e-4cf4-9244-a7408c62a861"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 5])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 22feef1b-3641-4f5b-812a-6e074694eb5c, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 146a0e88-01cd-4798-9a68-1d0d4d4898a9, kind: Service { id: 22feef1b-3641-4f5b-812a-6e074694eb5c }, name: Name("nexus-22feef1b-3641-4f5b-812a-6e074694eb5c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 116])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 38b01531-4202-4bd1-aa60-b1a0d98599e3, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: abda11aa-c7c1-4cc3-92a2-99b94f3157f0, kind: Service { id: 38b01531-4202-4bd1-aa60-b1a0d98599e3 }, name: Name("nexus-38b01531-4202-4bd1-aa60-b1a0d98599e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 117])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 5c0cc372-d135-4cad-85c1-9d822b358bba, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } } } }, OmicronZoneConfig { id: 715f5168-1120-43d3-afff-21f89d0bbaa1, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 082f20c1-e817-474e-960c-34ee887924b4, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: eb324745-26bc-4e5e-95d6-0812a97a4706, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 7fbbf0b3-3503-4308-b3c8-b7f429219325, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } } } }, OmicronZoneConfig { id: 520e66f4-c3b2-45a3-bc56-a4b8a15908f9, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } } } }, OmicronZoneConfig { id: c274f29a-0e2f-47cb-aeb9-f4e6528f99fe, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External } } } }, OmicronZoneConfig { id: d98fe4cb-8603-4152-90ae-dfd37d4299f6, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External } } } }, OmicronZoneConfig { id: d6e6ced2-9b95-4e22-89ed-a3457ea988e6, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External } } } }, OmicronZoneConfig { id: 52cdc140-3588-4e5a-9e40-c66f3fc84e54, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ceb4461c-cf56-4719-ad3c-14430bfdfb60, kind: External } } } }, OmicronZoneConfig { id: 1836c519-ef76-43dd-bdf3-9b7695cddf39, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: External } } } }, OmicronZoneConfig { id: 8ac3950d-a97f-436c-a7c4-6ec86cd2cdef, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } } } }, OmicronZoneConfig { id: d47ed049-99da-499f-add0-332af0fbd8d5, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:299 sled_address = [fd00:1122:3344:101::1]:12345
7542023-12-19T23:01:37.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39591
7552023-12-19T23:01:37.909ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7562023-12-19T23:01:37.909ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 1bd57612-2d1b-4a6a-8ec9-eb1ee2bf2ed4, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7572023-12-19T23:01:37.941ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7582023-12-19T23:01:37.941ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 18eb7385-4ed5-41f8-9b37-97eb0466d487, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7592023-12-19T23:01:37.970ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 23f90f02-1967-4f0c-905f-8557297e61a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7602023-12-19T23:01:37.970ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 23f90f02-1967-4f0c-905f-8557297e61a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7612023-12-19T23:01:38.000ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 27b27166-2734-4409-b6d8-9557b3956118, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7622023-12-19T23:01:38.000ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 27b27166-2734-4409-b6d8-9557b3956118, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7632023-12-19T23:01:38.028ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7642023-12-19T23:01:38.028ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: b3aefdf0-ff4a-4bda-9cf3-a9252914fcd4, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7652023-12-19T23:01:38.059ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a2b50530-cea8-44ca-9039-1c21722dae22, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7662023-12-19T23:01:38.059ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a2b50530-cea8-44ca-9039-1c21722dae22, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7672023-12-19T23:01:38.086ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8661716b-9deb-496e-a80f-9e7183d7d40c, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7682023-12-19T23:01:38.086ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 8661716b-9deb-496e-a80f-9e7183d7d40c, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7692023-12-19T23:01:38.116ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d1bf2dad-cfa5-403e-a7fc-29d6ef199701, dataset_name: DatasetName { pool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7702023-12-19T23:01:38.116ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: d1bf2dad-cfa5-403e-a7fc-29d6ef199701, dataset_name: DatasetName { pool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7712023-12-19T23:01:38.146ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 93d69613-245d-4c9d-bfae-666f10c736c7, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: ExternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7722023-12-19T23:01:38.146ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 93d69613-245d-4c9d-bfae-666f10c736c7, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: ExternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7732023-12-19T23:01:38.240ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: ExternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7742023-12-19T23:01:38.240ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: ExternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7752023-12-19T23:01:38.329ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Clickhouse }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7762023-12-19T23:01:38.329ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Clickhouse }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7772023-12-19T23:01:38.412ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7fbbf0b3-3503-4308-b3c8-b7f429219325, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7782023-12-19T23:01:38.412ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 7fbbf0b3-3503-4308-b3c8-b7f429219325, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7792023-12-19T23:01:38.499ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 520e66f4-c3b2-45a3-bc56-a4b8a15908f9, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7802023-12-19T23:01:38.499ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 520e66f4-c3b2-45a3-bc56-a4b8a15908f9, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7812023-12-19T23:01:38.586ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c274f29a-0e2f-47cb-aeb9-f4e6528f99fe, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7822023-12-19T23:01:38.587ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: c274f29a-0e2f-47cb-aeb9-f4e6528f99fe, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7832023-12-19T23:01:38.673ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d98fe4cb-8603-4152-90ae-dfd37d4299f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7842023-12-19T23:01:38.673ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: d98fe4cb-8603-4152-90ae-dfd37d4299f6, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7852023-12-19T23:01:38.760ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d6e6ced2-9b95-4e22-89ed-a3457ea988e6, dataset_name: DatasetName { pool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7862023-12-19T23:01:38.760ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: d6e6ced2-9b95-4e22-89ed-a3457ea988e6, dataset_name: DatasetName { pool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7872023-12-19T23:01:38.844ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 52cdc140-3588-4e5a-9e40-c66f3fc84e54, dataset_name: DatasetName { pool_name: ZpoolName { id: ceb4461c-cf56-4719-ad3c-14430bfdfb60, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7882023-12-19T23:01:38.845ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 52cdc140-3588-4e5a-9e40-c66f3fc84e54, dataset_name: DatasetName { pool_name: ZpoolName { id: ceb4461c-cf56-4719-ad3c-14430bfdfb60, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7892023-12-19T23:01:38.924ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1836c519-ef76-43dd-bdf3-9b7695cddf39, dataset_name: DatasetName { pool_name: ZpoolName { id: d462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7902023-12-19T23:01:38.925ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 1836c519-ef76-43dd-bdf3-9b7695cddf39, dataset_name: DatasetName { pool_name: ZpoolName { id: d462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7912023-12-19T23:01:39.007ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8ac3950d-a97f-436c-a7c4-6ec86cd2cdef, dataset_name: DatasetName { pool_name: ZpoolName { id: e4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7922023-12-19T23:01:39.007ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 8ac3950d-a97f-436c-a7c4-6ec86cd2cdef, dataset_name: DatasetName { pool_name: ZpoolName { id: e4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7932023-12-19T23:01:39.103ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d47ed049-99da-499f-add0-332af0fbd8d5, dataset_name: DatasetName { pool_name: ZpoolName { id: f4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } }) file = sled-storage/src/manager.rs:346
7942023-12-19T23:01:39.106ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: d47ed049-99da-499f-add0-332af0fbd8d5, dataset_name: DatasetName { pool_name: ZpoolName { id: f4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-storage/src/manager.rs:564
7952023-12-19T23:01:39.189ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
7962023-12-19T23:01:39.189ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/omicron-zones.json file = common/src/ledger.rs:176
7972023-12-19T23:01:39.190ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/omicron-zones.json file = common/src/ledger.rs:176
7982023-12-19T23:01:39.190ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
7992023-12-19T23:01:39.200ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:253
8002023-12-19T23:01:39.200ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8012023-12-19T23:01:39.200ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8022023-12-19T23:01:39.200ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8032023-12-19T23:01:39.200ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8042023-12-19T23:01:39.203ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:253
8052023-12-19T23:01:39.204ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8062023-12-19T23:01:39.205ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:253
8072023-12-19T23:01:39.211ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:253
8082023-12-19T23:01:39.212ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8092023-12-19T23:01:39.212ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8102023-12-19T23:01:39.212ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8112023-12-19T23:01:39.220ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:253
8122023-12-19T23:01:39.220ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8132023-12-19T23:01:39.220ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8142023-12-19T23:01:39.220ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8152023-12-19T23:01:39.220ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8162023-12-19T23:01:39.223ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8172023-12-19T23:01:39.223ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8182023-12-19T23:01:39.621ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706 file = illumos-utils/src/zone.rs:314
8192023-12-19T23:01:39.628ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5 file = illumos-utils/src/zone.rs:314
8202023-12-19T23:01:39.634ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9 file = illumos-utils/src/zone.rs:314
8212023-12-19T23:01:39.641ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4 file = illumos-utils/src/zone.rs:314
8222023-12-19T23:01:39.648ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325 file = illumos-utils/src/zone.rs:314
8232023-12-19T23:01:39.656ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe file = illumos-utils/src/zone.rs:314
8242023-12-19T23:01:39.662ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6 file = illumos-utils/src/zone.rs:314
8252023-12-19T23:01:39.669ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6 file = illumos-utils/src/zone.rs:314
8262023-12-19T23:01:39.676ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54 file = illumos-utils/src/zone.rs:314
8272023-12-19T23:01:39.682ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706 file = illumos-utils/src/zone.rs:353
8282023-12-19T23:01:39.687ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5 file = illumos-utils/src/zone.rs:353
8292023-12-19T23:01:39.693ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9 file = illumos-utils/src/zone.rs:353
8302023-12-19T23:01:39.699ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4 file = illumos-utils/src/zone.rs:353
8312023-12-19T23:01:39.706ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325 file = illumos-utils/src/zone.rs:353
8322023-12-19T23:01:39.713ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe file = illumos-utils/src/zone.rs:353
8332023-12-19T23:01:39.719ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6 file = illumos-utils/src/zone.rs:353
8342023-12-19T23:01:39.724ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6 file = illumos-utils/src/zone.rs:353
8352023-12-19T23:01:39.731ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54 file = illumos-utils/src/zone.rs:353
8362023-12-19T23:01:39.737ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39 file = illumos-utils/src/zone.rs:314
8372023-12-19T23:01:39.744ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef file = illumos-utils/src/zone.rs:314
8382023-12-19T23:01:39.751ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba file = illumos-utils/src/zone.rs:314
8392023-12-19T23:01:39.758ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81 file = illumos-utils/src/zone.rs:314
8402023-12-19T23:01:39.765ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1 file = illumos-utils/src/zone.rs:314
8412023-12-19T23:01:39.773ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39 file = illumos-utils/src/zone.rs:353
8422023-12-19T23:01:39.780ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef file = illumos-utils/src/zone.rs:353
8432023-12-19T23:01:39.787ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba file = illumos-utils/src/zone.rs:353
8442023-12-19T23:01:39.793ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81 file = illumos-utils/src/zone.rs:353
8452023-12-19T23:01:39.799ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1 file = illumos-utils/src/zone.rs:353
8462023-12-19T23:01:39.856ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:270
8472023-12-19T23:01:39.911ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:270
8482023-12-19T23:01:39.956ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:270
8492023-12-19T23:01:40.006ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:270
8502023-12-19T23:01:40.045ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:270
8512023-12-19T23:01:40.046ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:295
8522023-12-19T23:01:40.046ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:187
8532023-12-19T23:01:40.116ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:396 port = Port { inner: PortInner { name: "opte1", _ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 240, 134]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte1" } }
8542023-12-19T23:01:40.116ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1221 zone_type = external_dns
8552023-12-19T23:01:40.120ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:295
8562023-12-19T23:01:40.120ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:187
8572023-12-19T23:01:40.188ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:396 port = Port { inner: PortInner { name: "opte2", _ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 225, 102]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte2" } }
8582023-12-19T23:01:40.188ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1221 zone_type = external_dns
8592023-12-19T23:01:40.191ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:295
8602023-12-19T23:01:40.191ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:187
8612023-12-19T23:01:40.254ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:396 port = Port { inner: PortInner { name: "opte3", _ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 141, 116]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte3" } }
8622023-12-19T23:01:40.254ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1221 zone_type = nexus
8632023-12-19T23:01:40.256ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:295
8642023-12-19T23:01:40.256ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:187
8652023-12-19T23:01:40.323ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:396 port = Port { inner: PortInner { name: "opte4", _ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 184, 5]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte4" } }
8662023-12-19T23:01:40.323ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1221 zone_type = nexus
8672023-12-19T23:01:40.329ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:295
8682023-12-19T23:01:40.329ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:187
8692023-12-19T23:01:40.393ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:396 port = Port { inner: PortInner { name: "opte5", _ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 188, 117]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte5" } }
8702023-12-19T23:01:40.393ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1221 zone_type = nexus
8712023-12-19T23:01:40.394ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:98
8722023-12-19T23:01:40.394ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:105
8732023-12-19T23:01:40.396ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:98
8742023-12-19T23:01:40.396ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:105
8752023-12-19T23:01:40.397ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:133
8762023-12-19T23:01:40.400ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8772023-12-19T23:01:40.400ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:98
8782023-12-19T23:01:40.400ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:105
8792023-12-19T23:01:40.400ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:98
8802023-12-19T23:01:40.400ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:105
8812023-12-19T23:01:40.429ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:133
8822023-12-19T23:01:40.432ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:133
8832023-12-19T23:01:40.434ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8842023-12-19T23:01:40.434ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8852023-12-19T23:01:40.434ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:98
8862023-12-19T23:01:40.434ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:105
8872023-12-19T23:01:40.435ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:133
8882023-12-19T23:01:40.505ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:133
8892023-12-19T23:01:40.509ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8902023-12-19T23:01:40.509ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
8912023-12-19T23:01:40.541ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7 file = illumos-utils/src/zone.rs:314
8922023-12-19T23:01:40.547ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c file = illumos-utils/src/zone.rs:314
8932023-12-19T23:01:40.553ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861 file = illumos-utils/src/zone.rs:314
8942023-12-19T23:01:40.592ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e file = illumos-utils/src/zone.rs:314
8952023-12-19T23:01:40.600ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7 file = illumos-utils/src/zone.rs:353
8962023-12-19T23:01:40.605ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c file = illumos-utils/src/zone.rs:353
8972023-12-19T23:01:40.612ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861 file = illumos-utils/src/zone.rs:353
8982023-12-19T23:01:40.618ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3 file = illumos-utils/src/zone.rs:314
8992023-12-19T23:01:40.625ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e file = illumos-utils/src/zone.rs:353
9002023-12-19T23:01:40.650ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3 file = illumos-utils/src/zone.rs:353
9012023-12-19T23:01:42.427ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9022023-12-19T23:01:42.427ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
9032023-12-19T23:01:42.457ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9042023-12-19T23:01:42.458ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
9052023-12-19T23:01:42.576ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9062023-12-19T23:01:42.576ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
9072023-12-19T23:01:42.666ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="0f4cbe3a-d58d-48ad-b84d-2b828612f460"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9082023-12-19T23:01:42.666ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
9092023-12-19T23:01:42.680ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="cc1ae0ea-41c9-44c6-b164-483ae0ae45c6"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9102023-12-19T23:01:42.680ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
9112023-12-19T23:01:42.692ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="b3ef7b32-3b90-4eae-a90c-1e06990ba105"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9122023-12-19T23:01:42.692ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
9132023-12-19T23:01:42.725ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="be3177d8-b0bb-48a9-aa25-7207ec5a6ee6"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9142023-12-19T23:01:42.725ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
9152023-12-19T23:01:42.762ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
9162023-12-19T23:01:42.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 55.193162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
9172023-12-19T23:01:42.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 47.528876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
9182023-12-19T23:01:42.823ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="9095b883-7215-41af-a248-42ce6d1f39c8"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9192023-12-19T23:01:42.823ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
9202023-12-19T23:01:42.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 63.737197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
9212023-12-19T23:01:42.845ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="f1a4064d-ae82-4b88-a131-a554b8b8aad2"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9222023-12-19T23:01:42.845ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
9232023-12-19T23:01:42.860ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
9242023-12-19T23:01:42.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 131.851835ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
9252023-12-19T23:01:42.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 105.366107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
9262023-12-19T23:01:43.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 114.95243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
9272023-12-19T23:01:43.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 268.587386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
9282023-12-19T23:01:43.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 237.758943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
9292023-12-19T23:01:43.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 33.845841ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
9302023-12-19T23:01:43.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 44.600111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
9312023-12-19T23:01:43.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 35.562192ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
9322023-12-19T23:01:43.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 40.923736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
9332023-12-19T23:01:43.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 70.966605ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
9342023-12-19T23:01:43.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 173.073819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
9352023-12-19T23:01:43.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 563.574418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
9362023-12-19T23:01:43.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 130.980021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
9372023-12-19T23:01:43.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 116.540015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
9382023-12-19T23:01:43.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 275.265661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
9392023-12-19T23:01:43.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 149.197456ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
9402023-12-19T23:01:43.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 37.373986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
9412023-12-19T23:01:43.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 127.24694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
9422023-12-19T23:01:43.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 71.395558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
9432023-12-19T23:01:43.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 77.098316ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
9442023-12-19T23:01:43.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 455.088443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
9452023-12-19T23:01:43.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 100.603011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
9462023-12-19T23:01:44.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 110.990669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
9472023-12-19T23:01:44.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 1.19799346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
9482023-12-19T23:01:44.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 141.843377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
9492023-12-19T23:01:44.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 67.482848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
9502023-12-19T23:01:44.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 204.154772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
9512023-12-19T23:01:44.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 65.064655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
9522023-12-19T23:01:44.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 151.616557ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
9532023-12-19T23:01:44.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 638.578116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
9542023-12-19T23:01:44.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 1.037456784s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
9552023-12-19T23:01:44.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 503.421803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
9562023-12-19T23:01:45.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 346.853772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
9572023-12-19T23:01:45.045ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
9582023-12-19T23:01:45.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 293.929179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
9592023-12-19T23:01:45.068ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
9602023-12-19T23:01:45.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 132.319012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
9612023-12-19T23:01:45.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 391.676667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
9622023-12-19T23:01:45.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 183.389661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
9632023-12-19T23:01:45.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 339.931849ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
9642023-12-19T23:01:45.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 535.333873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
9652023-12-19T23:01:45.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 623.127427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
9662023-12-19T23:01:45.286ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="d07eff5b-95ca-486d-b358-63aaa916840f"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9672023-12-19T23:01:45.286ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
9682023-12-19T23:01:45.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 37.937442ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
9692023-12-19T23:01:45.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 67.809548ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
9702023-12-19T23:01:45.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 233.425683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
9712023-12-19T23:01:45.319ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="1136183e-e2d9-4dfb-8da4-9b8846fed81c"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9722023-12-19T23:01:45.319ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
9732023-12-19T23:01:45.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 143.427255ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
9742023-12-19T23:01:45.351ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="337ae769-1376-41e5-8fa8-b813854d631e"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9752023-12-19T23:01:45.352ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
9762023-12-19T23:01:45.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 729.985225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
9772023-12-19T23:01:45.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 64.170602ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
9782023-12-19T23:01:45.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 459.898303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
9792023-12-19T23:01:45.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 1.393266378s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
9802023-12-19T23:01:45.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 536.341887ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
9812023-12-19T23:01:45.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 108.004229ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
9822023-12-19T23:01:45.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 152.842021ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
9832023-12-19T23:01:45.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 1.188556997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
9842023-12-19T23:01:45.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 691.749885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
9852023-12-19T23:01:45.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.02689112s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
9862023-12-19T23:01:45.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 38.815395ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
9872023-12-19T23:01:45.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 238.528419ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
9882023-12-19T23:01:45.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 132.47704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
9892023-12-19T23:01:45.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 365.591645ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
9902023-12-19T23:01:45.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 65.21876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
9912023-12-19T23:01:45.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 51.458286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
9922023-12-19T23:01:45.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 1.072847869s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
9932023-12-19T23:01:46.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 584.843328ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
9942023-12-19T23:01:46.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 79.385885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
9952023-12-19T23:01:46.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 86.316602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
9962023-12-19T23:01:46.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 208.627483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
9972023-12-19T23:01:46.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 1.151912078s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
9982023-12-19T23:01:46.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 894.142981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
9992023-12-19T23:01:46.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 643.243638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
10002023-12-19T23:01:46.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 1.09258077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
10012023-12-19T23:01:46.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 575.409428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
10022023-12-19T23:01:46.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 124.288267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
10032023-12-19T23:01:46.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 199.268327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
10042023-12-19T23:01:46.238ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
10052023-12-19T23:01:46.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 513.043422ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
10062023-12-19T23:01:46.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 1.424386134s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
10072023-12-19T23:01:46.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 284.880034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
10082023-12-19T23:01:46.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 420.640462ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
10092023-12-19T23:01:46.392ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
10102023-12-19T23:01:46.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 577.303319ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
10112023-12-19T23:01:46.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 38.149247ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
10122023-12-19T23:01:46.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 80.204734ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
10132023-12-19T23:01:46.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 804.836536ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
10142023-12-19T23:01:46.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 806.245721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
10152023-12-19T23:01:46.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 271.812281ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
10162023-12-19T23:01:46.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.336960562s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
10172023-12-19T23:01:46.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 65.770877ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
10182023-12-19T23:01:46.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 1.409111491s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
10192023-12-19T23:01:46.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 1.224497441s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
10202023-12-19T23:01:46.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 589.234325ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
10212023-12-19T23:01:46.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 666.054211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
10222023-12-19T23:01:46.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 54.552261ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
10232023-12-19T23:01:46.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 706.568776ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
10242023-12-19T23:01:46.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 1.098499677s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
10252023-12-19T23:01:46.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 545.130547ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
10262023-12-19T23:01:47.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 158.029906ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
10272023-12-19T23:01:47.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 899.760686ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
10282023-12-19T23:01:47.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 828.358847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
10292023-12-19T23:01:47.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 1.320643632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
10302023-12-19T23:01:47.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 444.670153ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
10312023-12-19T23:01:47.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 1.379246769s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
10322023-12-19T23:01:47.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 818.879508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
10332023-12-19T23:01:47.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 1.442597916s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
10342023-12-19T23:01:47.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 1.312657521s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
10352023-12-19T23:01:47.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 661.32238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
10362023-12-19T23:01:47.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 755.307361ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
10372023-12-19T23:01:47.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 1.191901996s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
10382023-12-19T23:01:47.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 495.996473ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
10392023-12-19T23:01:47.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 790.934692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
10402023-12-19T23:01:47.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 1.086830888s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
10412023-12-19T23:01:47.863ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
10422023-12-19T23:01:47.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 992.425707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
10432023-12-19T23:01:47.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 1.138082233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
10442023-12-19T23:01:48.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 1.147039434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
10452023-12-19T23:01:48.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 1.428419993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
10462023-12-19T23:01:48.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.492086143s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
10472023-12-19T23:01:48.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 957.655928ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
10482023-12-19T23:01:48.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 911.110424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
10492023-12-19T23:01:48.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 1.086187219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
10502023-12-19T23:01:48.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 1.056750452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
10512023-12-19T23:01:48.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 838.110198ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
10522023-12-19T23:01:48.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 1.073211657s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
10532023-12-19T23:01:48.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 605.708785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
10542023-12-19T23:01:48.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 889.539579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
10552023-12-19T23:01:48.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 1.491440224s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
10562023-12-19T23:01:48.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 724.486152ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
10572023-12-19T23:01:48.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 667.4969ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
10582023-12-19T23:01:48.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 1.466605775s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
10592023-12-19T23:01:48.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 1.270866256s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
10602023-12-19T23:01:49.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 1.41004868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
10612023-12-19T23:01:49.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 841.443373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
10622023-12-19T23:01:49.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 735.135547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
10632023-12-19T23:01:49.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 808.597917ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
10642023-12-19T23:01:49.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 1.438871638s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
10652023-12-19T23:01:49.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 616.042239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
10662023-12-19T23:01:49.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 951.296581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
10672023-12-19T23:01:49.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 753.761563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
10682023-12-19T23:01:49.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 1.462149065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
10692023-12-19T23:01:49.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 1.431401347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
10702023-12-19T23:01:49.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 1.022168287s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
10712023-12-19T23:01:49.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 883.772205ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
10722023-12-19T23:01:49.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 1.308602832s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
10732023-12-19T23:01:49.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 1.288775595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
10742023-12-19T23:01:49.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 582.524199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
10752023-12-19T23:01:49.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 1.258627923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
10762023-12-19T23:01:49.909ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
10772023-12-19T23:01:49.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 737.254637ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
10782023-12-19T23:01:49.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 1.296455039s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
10792023-12-19T23:01:50.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 1.315331125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
10802023-12-19T23:01:50.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 1.128421274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
10812023-12-19T23:01:50.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 46.371263ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
10822023-12-19T23:01:50.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 1.224061854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
10832023-12-19T23:01:50.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 63.08514ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
10842023-12-19T23:01:50.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 276.343277ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
10852023-12-19T23:01:50.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 1.494741888s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
10862023-12-19T23:01:50.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 1.029206831s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
10872023-12-19T23:01:50.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 931.72011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
10882023-12-19T23:01:50.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.087094835s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
10892023-12-19T23:01:50.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 943.771671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
10902023-12-19T23:01:50.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 615.544633ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
10912023-12-19T23:01:50.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 1.194901793s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
10922023-12-19T23:01:50.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 266.038421ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
10932023-12-19T23:01:50.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 555.275696ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
10942023-12-19T23:01:50.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 583.978685ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
10952023-12-19T23:01:50.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 415.946691ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
10962023-12-19T23:01:50.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 636.740668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
10972023-12-19T23:01:50.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 1.281578896s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
10982023-12-19T23:01:51.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 1.030537429s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
10992023-12-19T23:01:51.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 883.511298ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
11002023-12-19T23:01:51.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 1.347857787s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
11012023-12-19T23:01:51.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 1.355065462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
11022023-12-19T23:01:51.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 1.428995773s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
11032023-12-19T23:01:51.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 1.203869297s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
11042023-12-19T23:01:51.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 1.169511211s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
11052023-12-19T23:01:51.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 883.890022ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
11062023-12-19T23:01:51.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 597.479388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
11072023-12-19T23:01:51.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 1.147325736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
11082023-12-19T23:01:51.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 1.06890265s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
11092023-12-19T23:01:51.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 782.104928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
11102023-12-19T23:01:51.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 1.468570935s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
11112023-12-19T23:01:51.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.416205662s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
11122023-12-19T23:01:51.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 1.087118375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
11132023-12-19T23:01:51.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 512.757794ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
11142023-12-19T23:01:51.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 719.899891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
11152023-12-19T23:01:51.928ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11162023-12-19T23:01:51.928ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
11172023-12-19T23:01:52.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 1.054745634s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
11182023-12-19T23:01:52.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 1.358244589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
11192023-12-19T23:01:52.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 1.494021742s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
11202023-12-19T23:01:52.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 62.889ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
11212023-12-19T23:01:52.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 87.358486ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
11222023-12-19T23:01:52.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 642.119487ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
11232023-12-19T23:01:52.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 838.572767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
11242023-12-19T23:01:52.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 513.816735ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
11252023-12-19T23:01:52.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 170.414051ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
11262023-12-19T23:01:52.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 524.345994ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
11272023-12-19T23:01:52.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 406.711469ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
11282023-12-19T23:01:52.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 1.445729892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
11292023-12-19T23:01:52.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 799.913527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
11302023-12-19T23:01:52.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 724.419932ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
11312023-12-19T23:01:52.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 778.079816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
11322023-12-19T23:01:52.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 773.436955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
11332023-12-19T23:01:52.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 1.014604736s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
11342023-12-19T23:01:52.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 861.962761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
11352023-12-19T23:01:52.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 1.261413169s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
11362023-12-19T23:01:52.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 863.085145ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
11372023-12-19T23:01:52.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 597.230184ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
11382023-12-19T23:01:52.864ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
11392023-12-19T23:01:52.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 962.293934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
11402023-12-19T23:01:52.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 1.131291248s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
11412023-12-19T23:01:53.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 488.866538ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
11422023-12-19T23:01:53.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.423499954s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
11432023-12-19T23:01:53.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 502.936493ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
11442023-12-19T23:01:53.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 1.451456583s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
11452023-12-19T23:01:53.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 1.41320865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
11462023-12-19T23:01:53.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 847.919634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
11472023-12-19T23:01:53.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 1.322364507s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
11482023-12-19T23:01:53.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 1.491855865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
11492023-12-19T23:01:53.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 767.94941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
11502023-12-19T23:01:53.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 665.655487ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
11512023-12-19T23:01:53.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 1.338242023s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
11522023-12-19T23:01:53.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 797.880491ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
11532023-12-19T23:01:53.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 1.143375862s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
11542023-12-19T23:01:53.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 1.278784481s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
11552023-12-19T23:01:53.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 524.133578ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
11562023-12-19T23:01:53.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 1.227701266s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
11572023-12-19T23:01:53.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 743.978031ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
11582023-12-19T23:01:53.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 944.313738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
11592023-12-19T23:01:53.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 1.258657087s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
11602023-12-19T23:01:54.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 1.323187473s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
11612023-12-19T23:01:54.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 842.778047ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
11622023-12-19T23:01:54.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 1.337327687s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
11632023-12-19T23:01:54.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 1.076567028s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
11642023-12-19T23:01:54.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 589.709535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
11652023-12-19T23:01:54.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 1.134202439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
11662023-12-19T23:01:54.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 1.499864388s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
11672023-12-19T23:01:54.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 1.152259916s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
11682023-12-19T23:01:54.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.104026113s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
11692023-12-19T23:01:54.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 563.759813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
11702023-12-19T23:01:54.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 733.573334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
11712023-12-19T23:01:54.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 535.882978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
11722023-12-19T23:01:54.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 785.609358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
11732023-12-19T23:01:54.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 565.236129ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
11742023-12-19T23:01:54.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 570.245381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
11752023-12-19T23:01:54.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 1.477649439s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
11762023-12-19T23:01:54.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 693.35743ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
11772023-12-19T23:01:54.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 551.028516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
11782023-12-19T23:01:54.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 849.084481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
11792023-12-19T23:01:54.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 1.283341567s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
11802023-12-19T23:01:55.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 879.737205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
11812023-12-19T23:01:55.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 565.930388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
11822023-12-19T23:01:55.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 591.030598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
11832023-12-19T23:01:55.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 812.072215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
11842023-12-19T23:01:55.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 878.709521ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
11852023-12-19T23:01:55.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 940.915509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
11862023-12-19T23:01:55.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 1.105742809s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
11872023-12-19T23:01:55.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 931.16048ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
11882023-12-19T23:01:55.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 658.672313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
11892023-12-19T23:01:55.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 1.064952898s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
11902023-12-19T23:01:55.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 944.10103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
11912023-12-19T23:01:55.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 901.764833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
11922023-12-19T23:01:55.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 920.994968ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
11932023-12-19T23:01:55.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 575.976122ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
11942023-12-19T23:01:55.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 557.65737ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
11952023-12-19T23:01:55.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 892.681027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
11962023-12-19T23:01:55.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 834.83498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
11972023-12-19T23:01:55.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 584.482961ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
11982023-12-19T23:01:55.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 771.404106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
11992023-12-19T23:01:56.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 1.434153529s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
12002023-12-19T23:01:56.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 1.41648015s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
12012023-12-19T23:01:56.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 971.78621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
12022023-12-19T23:01:56.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.461711809s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
12032023-12-19T23:01:56.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 920.40664ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
12042023-12-19T23:01:56.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 532.301486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
12052023-12-19T23:01:56.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 1.328532007s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
12062023-12-19T23:01:56.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 980.705486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
12072023-12-19T23:01:56.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 871.573273ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
12082023-12-19T23:01:56.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 740.880846ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
12092023-12-19T23:01:56.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 1.292643267s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
12102023-12-19T23:01:56.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 860.72355ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
12112023-12-19T23:01:56.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 509.413945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
12122023-12-19T23:01:56.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 1.183541464s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
12132023-12-19T23:01:56.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 1.40433293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
12142023-12-19T23:01:56.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 745.873581ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
12152023-12-19T23:01:56.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 1.214304418s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
12162023-12-19T23:01:56.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 1.2116264s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
12172023-12-19T23:01:56.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 810.843287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
12182023-12-19T23:01:56.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 1.460063915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
12192023-12-19T23:01:57.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 1.467074166s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
12202023-12-19T23:01:57.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 856.228711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
12212023-12-19T23:01:57.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 1.33276293s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
12222023-12-19T23:01:57.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 1.014701939s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
12232023-12-19T23:01:57.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 1.047321848s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
12242023-12-19T23:01:57.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 834.949169ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
12252023-12-19T23:01:57.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 1.326849038s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
12262023-12-19T23:01:57.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 1.251078262s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
12272023-12-19T23:01:57.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 1.394947065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
12282023-12-19T23:01:57.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 848.323662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
12292023-12-19T23:01:57.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 756.697732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
12302023-12-19T23:01:57.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 1.183306009s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
12312023-12-19T23:01:57.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.003772992s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
12322023-12-19T23:01:57.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 585.119357ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
12332023-12-19T23:01:57.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 796.582201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
12342023-12-19T23:01:57.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 550.40715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
12352023-12-19T23:01:57.865ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
12362023-12-19T23:01:57.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 697.326128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
12372023-12-19T23:01:57.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 845.252585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
12382023-12-19T23:01:57.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 981.766257ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
12392023-12-19T23:01:58.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 1.18207989s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
12402023-12-19T23:01:58.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 889.481173ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
12412023-12-19T23:01:58.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 777.077246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
12422023-12-19T23:01:58.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 858.969383ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
12432023-12-19T23:01:58.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 570.332026ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
12442023-12-19T23:01:58.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 1.469417025s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
12452023-12-19T23:01:58.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 1.395513542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
12462023-12-19T23:01:58.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 693.184353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
12472023-12-19T23:01:58.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 1.405839807s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
12482023-12-19T23:01:58.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 1.407657931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
12492023-12-19T23:01:58.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 791.473025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
12502023-12-19T23:01:58.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 1.131395889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
12512023-12-19T23:01:58.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 967.335462ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
12522023-12-19T23:01:58.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 607.17362ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
12532023-12-19T23:01:58.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 1.030525989s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
12542023-12-19T23:01:58.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 1.29071458s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
12552023-12-19T23:01:58.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 1.32620106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
12562023-12-19T23:01:58.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 1.101684365s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
12572023-12-19T23:01:58.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 608.398866ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
12582023-12-19T23:01:58.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 507.46642ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
12592023-12-19T23:01:59.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 848.906682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
12602023-12-19T23:01:59.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 1.285637062s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
12612023-12-19T23:01:59.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 1.226529691s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
12622023-12-19T23:01:59.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 1.122947744s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
12632023-12-19T23:01:59.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.095136432s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
12642023-12-19T23:01:59.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 1.232683704s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
12652023-12-19T23:01:59.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 997.765326ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
12662023-12-19T23:01:59.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 1.05619324s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
12672023-12-19T23:01:59.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 1.182070655s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
12682023-12-19T23:01:59.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 875.961893ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
12692023-12-19T23:01:59.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 1.020200042s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
12702023-12-19T23:01:59.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 1.226741117s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
12712023-12-19T23:01:59.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 1.036440075s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
12722023-12-19T23:01:59.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 1.02740691s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
12732023-12-19T23:01:59.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 1.270460089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
12742023-12-19T23:01:59.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 660.291335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
12752023-12-19T23:01:59.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 1.135500106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
12762023-12-19T23:01:59.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 1.304880426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
12772023-12-19T23:02:00.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 585.396972ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
12782023-12-19T23:02:00.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 526.535778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
12792023-12-19T23:02:00.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 993.751214ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
12802023-12-19T23:02:00.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 647.330864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
12812023-12-19T23:02:00.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 697.438894ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
12822023-12-19T23:02:00.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 581.208026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
12832023-12-19T23:02:00.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.138362975s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
12842023-12-19T23:02:00.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 1.140801564s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
12852023-12-19T23:02:00.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 786.928604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
12862023-12-19T23:02:00.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 1.387876407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
12872023-12-19T23:02:00.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 1.245684168s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
12882023-12-19T23:02:00.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 1.383661423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
12892023-12-19T23:02:00.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 1.433100252s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
12902023-12-19T23:02:00.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 1.397501078s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
12912023-12-19T23:02:00.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 1.13006768s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
12922023-12-19T23:02:00.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5") failed: Property not found. retry in 1.240561566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47ed049-99da-499f-add0-332af0fbd8d5
12932023-12-19T23:02:00.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 1.215531096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
12942023-12-19T23:02:00.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 603.602729ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
12952023-12-19T23:02:00.972ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48428
12962023-12-19T23:02:00.972ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 193 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48428 req_id = d0816099-fd0e-486a-ad51-029ce4c78c5a response_code = 200 uri = /baseboard
12972023-12-19T23:02:00.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 586.081855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
12982023-12-19T23:02:01.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 1.419812214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
12992023-12-19T23:02:01.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 1.142532024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
13002023-12-19T23:02:01.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 1.230451816s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
13012023-12-19T23:02:01.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 728.390034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
13022023-12-19T23:02:01.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 607.808075ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
13032023-12-19T23:02:01.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 1.304194931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
13042023-12-19T23:02:01.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325") failed: Property not found. retry in 857.80779ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fbbf0b3-3503-4308-b3c8-b7f429219325
13052023-12-19T23:02:01.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba") failed: Property not found. retry in 1.166950108s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
13062023-12-19T23:02:01.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 741.226527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
13072023-12-19T23:02:01.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9") failed: Property not found. retry in 550.962309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_520e66f4-c3b2-45a3-bc56-a4b8a15908f9
13082023-12-19T23:02:01.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 612.513215ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
13092023-12-19T23:02:01.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3") failed: Property not found. retry in 1.016920413s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
13102023-12-19T23:02:01.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39") failed: Property not found. retry in 1.354924463s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1836c519-ef76-43dd-bdf3-9b7695cddf39
13112023-12-19T23:02:01.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4") failed: Property not found. retry in 1.132247326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_082f20c1-e817-474e-960c-34ee887924b4
13122023-12-19T23:02:01.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7") failed: Property not found. retry in 1.240763475s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
13132023-12-19T23:02:01.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706") failed: Property not found. retry in 921.556588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_eb324745-26bc-4e5e-95d6-0812a97a4706
13142023-12-19T23:02:02.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe") failed: Property not found. retry in 811.337841ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c274f29a-0e2f-47cb-aeb9-f4e6528f99fe
13152023-12-19T23:02:02.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef") failed: Property not found. retry in 973.33019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8ac3950d-a97f-436c-a7c4-6ec86cd2cdef
13162023-12-19T23:02:02.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c") failed: Property not found. retry in 1.258542132s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
13172023-12-19T23:02:02.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861") failed: Property not found. retry in 1.461174366s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
13182023-12-19T23:02:02.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e") failed: Property not found. retry in 944.248832ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
13192023-12-19T23:02:02.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6") failed: Property not found. retry in 1.014409209s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d98fe4cb-8603-4152-90ae-dfd37d4299f6
13202023-12-19T23:02:02.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6") failed: Property not found. retry in 1.185453697s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d6e6ced2-9b95-4e22-89ed-a3457ea988e6
13212023-12-19T23:02:02.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54") failed: Property not found. retry in 783.681328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_52cdc140-3588-4e5a-9e40-c66f3fc84e54
13222023-12-19T23:02:02.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81") failed: Property not found. retry in 1.375244328s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b7ac2af6-17fd-4d90-8ddd-8a5571b8ab81
13232023-12-19T23:02:02.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1") failed: Property not found. retry in 1.179506959s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_715f5168-1120-43d3-afff-21f89d0bbaa1
13242023-12-19T23:02:02.810ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::d exists file = sled-agent/src/services.rs:1764
13252023-12-19T23:02:02.810ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::d, prefix: 64 })) file = illumos-utils/src/running_zone.rs:608 zone = oxz_oximeter_5c0cc372-d135-4cad-85c1-9d822b358bba
13262023-12-19T23:02:03.392ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::d exists - OK file = sled-agent/src/services.rs:1772
13272023-12-19T23:02:03.392ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1791
13282023-12-19T23:02:13.204ZINFOSledAgent (ServiceManager): Setting up oximeter service file = sled-agent/src/services.rs:2059
13292023-12-19T23:02:13.525ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
13302023-12-19T23:02:13.742ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::9 exists file = sled-agent/src/services.rs:1764
13312023-12-19T23:02:13.742ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::9, prefix: 64 })) file = illumos-utils/src/running_zone.rs:608 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
13322023-12-19T23:02:14.296ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::9 exists - OK file = sled-agent/src/services.rs:1772
13332023-12-19T23:02:14.296ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1791
13342023-12-19T23:02:15.597ZINFOSledAgent (ServiceManager): Setting up external-dns service file = sled-agent/src/services.rs:1948
13352023-12-19T23:02:15.597ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:652 zone = oxz_external_dns_d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e
13362023-12-19T23:02:18.531ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
13372023-12-19T23:02:20.801ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::8 exists file = sled-agent/src/services.rs:1764
13382023-12-19T23:02:20.802ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::8, prefix: 64 })) file = illumos-utils/src/running_zone.rs:608 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
13392023-12-19T23:02:21.364ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::8 exists - OK file = sled-agent/src/services.rs:1772
13402023-12-19T23:02:21.364ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1791
13412023-12-19T23:02:21.770ZINFOSledAgent (ServiceManager): Setting up external-dns service file = sled-agent/src/services.rs:1948
13422023-12-19T23:02:21.770ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:652 zone = oxz_external_dns_93d69613-245d-4c9d-bfae-666f10c736c7
13432023-12-19T23:02:23.533ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
13442023-12-19T23:02:27.203ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::b exists file = sled-agent/src/services.rs:1764
13452023-12-19T23:02:27.203ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::b, prefix: 64 })) file = illumos-utils/src/running_zone.rs:608 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
13462023-12-19T23:02:27.762ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::b exists - OK file = sled-agent/src/services.rs:1772
13472023-12-19T23:02:27.762ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1791
13482023-12-19T23:02:27.967ZINFOSledAgent (ServiceManager): Setting up Nexus service file = sled-agent/src/services.rs:1835
13492023-12-19T23:02:27.967ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:652 zone = oxz_nexus_22feef1b-3641-4f5b-812a-6e074694eb5c
13502023-12-19T23:02:28.534ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
13512023-12-19T23:02:31.008ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48910
13522023-12-19T23:02:31.008ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48910 req_id = 42399146-ea4c-49b1-887f-b49778cdb531 response_code = 200 uri = /baseboard
13532023-12-19T23:02:33.536ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
13542023-12-19T23:02:34.261ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::a exists file = sled-agent/src/services.rs:1764
13552023-12-19T23:02:34.261ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::a, prefix: 64 })) file = illumos-utils/src/running_zone.rs:608 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
13562023-12-19T23:02:34.817ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::a exists - OK file = sled-agent/src/services.rs:1772
13572023-12-19T23:02:34.817ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1791
13582023-12-19T23:02:35.027ZINFOSledAgent (ServiceManager): Setting up Nexus service file = sled-agent/src/services.rs:1835
13592023-12-19T23:02:35.027ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:652 zone = oxz_nexus_84fda2b6-423e-4cf4-9244-a7408c62a861
13602023-12-19T23:02:38.539ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
13612023-12-19T23:02:40.794ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::c exists file = sled-agent/src/services.rs:1764
13622023-12-19T23:02:40.794ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::c, prefix: 64 })) file = illumos-utils/src/running_zone.rs:608 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
13632023-12-19T23:02:41.349ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::c exists - OK file = sled-agent/src/services.rs:1772
13642023-12-19T23:02:41.351ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1791
13652023-12-19T23:02:41.557ZINFOSledAgent (ServiceManager): Setting up Nexus service file = sled-agent/src/services.rs:1835
13662023-12-19T23:02:41.557ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:652 zone = oxz_nexus_38b01531-4202-4bd1-aa60-b1a0d98599e3
13672023-12-19T23:02:43.540ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
13682023-12-19T23:02:44.823ZWARNSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: tcp connect error: Connection refused (os error 146)" file = sled-agent/src/storage_monitor.rs:223 total duration = 218.279016801s
13692023-12-19T23:02:45.074ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/b462a7f7-b628-40fe-80ff-4e4189e2d62b): error trying to connect: tcp connect error: Connection refused (os error 146)" file = sled-agent/src/storage_monitor.rs:273 total duration = 218.5247962s
13702023-12-19T23:02:45.074ZWARNSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: tcp connect error: Connection refused (os error 146)" file = sled-agent/src/storage_monitor.rs:223 total duration = 218.529985862s
13712023-12-19T23:02:45.643ZWARNSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: tcp connect error: Connection refused (os error 146)" file = sled-agent/src/storage_monitor.rs:223 total duration = 219.096360029s
13722023-12-19T23:02:45.783ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/f4b4dc87-ab46-49fb-a4b4-d361ae214c03): error trying to connect: tcp connect error: Connection refused (os error 146)" file = sled-agent/src/storage_monitor.rs:273 total duration = 219.233509256s
13732023-12-19T23:02:45.883ZWARNSledAgent: failed to register as a metric producer with Nexus error = "Metric registration error: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = sled-agent/src/sled_agent.rs:1076 retry_after = 17.674036479s sled_id = 097821eb-36d2-4a1a-98a7-92f64e03f037
13742023-12-19T23:02:46.073ZWARNSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: tcp connect error: Connection refused (os error 146)" file = sled-agent/src/storage_monitor.rs:223 total duration = 219.526847504s
13752023-12-19T23:02:46.163ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/cd70d7f6-2354-4bf2-8012-55bf9eaf7930): error trying to connect: tcp connect error: Connection refused (os error 146)" file = sled-agent/src/storage_monitor.rs:273 total duration = 219.613848637s
13762023-12-19T23:02:46.213ZWARNSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: M2, vendor: "synthetic-vendor" }) err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/physical-disk): error trying to connect: tcp connect error: Connection refused (os error 146)" file = sled-agent/src/storage_monitor.rs:223 total duration = 219.666463346s
13772023-12-19T23:02:46.243ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/14b4dc87-ab46-49fb-a4b4-d361ae214c03): error trying to connect: tcp connect error: Connection refused (os error 146)" file = sled-agent/src/storage_monitor.rs:273 total duration = 219.695109972s
13782023-12-19T23:02:46.473ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:198
13792023-12-19T23:02:46.475ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.omicron-zones.json.tmp file = common/src/ledger.rs:198
13802023-12-19T23:02:46.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 68569015 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39591 req_id = 65b0f499-05f8-4f59-bc3d-d89e882cf9fe response_code = 204 uri = /omicron-zones
13812023-12-19T23:02:46.491ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1062
13822023-12-19T23:02:46.491ZINFOSledAgent (RSS): Writing ledger to /pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:198
13832023-12-19T23:02:46.491ZINFOSledAgent (RSS): Writing ledger to /pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:198
13842023-12-19T23:02:46.495ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:549
13852023-12-19T23:02:46.495ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:551
13862023-12-19T23:02:46.537ZINFOSledAgent (RSS): rack_network_config: Some( RackNetworkConfigV1 { bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { addresses: [ V4( Ipv4Network { addr: 10.151.2.174, prefix: 32, }, ), ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.2.100, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Network { addr: fd00:1122:3344:1::, prefix: 56, }, }, ) file = sled-agent/src/rack_setup/service.rs:658
13872023-12-19T23:02:46.538ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a900c9d8-85d5-4d11-8e94-59a15fbbcc5a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:679
13882023-12-19T23:02:46.604ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a900c9d8-85d5-4d11-8e94-59a15fbbcc5a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:679
13892023-12-19T23:02:46.740ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a900c9d8-85d5-4d11-8e94-59a15fbbcc5a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:679
13902023-12-19T23:02:46.943ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", model: "synthetic-model" } err = "Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/097821eb-36d2-4a1a-98a7-92f64e03f037/zpools/ceb4461c-cf56-4719-ad3c-14430bfdfb60): error trying to connect: tcp connect error: Connection refused (os error 146)" file = sled-agent/src/storage_monitor.rs:273 total duration = 220.394281845s
13912023-12-19T23:02:46.947ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a900c9d8-85d5-4d11-8e94-59a15fbbcc5a/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:679
13922023-12-19T23:02:47.102ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "69479487-57cc-4a63-b46b-8706e18fd824", "content-length": "113", "date": "Tue, 19 Dec 2023 23:02:47 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "69479487-57cc-4a63-b46b-8706e18fd824" } file = sled-agent/src/rack_setup/service.rs:679
13932023-12-19T23:02:47.127ZWARNSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Error Response: status: 403 Forbidden; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"a501f6d7-9782-4f75-9b1d-495ef89b2124\\", \\"content-length\\": \\"113\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:47 GMT\\"}; value: Error { error_code: Some(\\"Forbidden\\"), message: \\"Forbidden\\", request_id: \\"a501f6d7-9782-4f75-9b1d-495ef89b2124\\" }" file = sled-agent/src/storage_monitor.rs:223 total duration = 220.579813162s
13942023-12-19T23:02:47.133ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", model: "synthetic-model" } err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"e6d925b7-ae3f-488a-b9bf-cd5c7b226a1f\\", \\"content-length\\": \\"272\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:47 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: physical-disk with id \\\\\\"vendor = \\\\\\"synthetic-vendor\\\\\\", serial = \\\\\\"synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7\\\\\\", model = \\\\\\"synthetic-model\\\\\\"\\\\\\"\\", request_id: \\"e6d925b7-ae3f-488a-b9bf-cd5c7b226a1f\\" }" file = sled-agent/src/storage_monitor.rs:273 total duration = 220.584716029s
13952023-12-19T23:02:47.218ZWARNSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: M2, vendor: "synthetic-vendor" }) err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"916d2c4a-59fb-4573-9415-ea0ed076bfc4\\", \\"content-length\\": \\"173\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:47 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: sled with id \\\\\\"097821eb-36d2-4a1a-98a7-92f64e03f037\\\\\\"\\", request_id: \\"916d2c4a-59fb-4573-9415-ea0ed076bfc4\\" }" file = sled-agent/src/storage_monitor.rs:223 total duration = 220.670748459s
13962023-12-19T23:02:47.259ZWARNSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"8ba1242a-436a-44a0-b3d7-f2e1f65b0bbc\\", \\"content-length\\": \\"173\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:47 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: sled with id \\\\\\"097821eb-36d2-4a1a-98a7-92f64e03f037\\\\\\"\\", request_id: \\"8ba1242a-436a-44a0-b3d7-f2e1f65b0bbc\\" }" file = sled-agent/src/storage_monitor.rs:223 total duration = 220.711691387s
13972023-12-19T23:02:47.262ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"b1ff9226-0f43-419a-a339-301b1bb39f3b\\", \\"content-length\\": \\"272\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:47 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: physical-disk with id \\\\\\"vendor = \\\\\\"synthetic-vendor\\\\\\", serial = \\\\\\"synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b\\\\\\", model = \\\\\\"synthetic-model\\\\\\"\\\\\\"\\", request_id: \\"b1ff9226-0f43-419a-a339-301b1bb39f3b\\" }" file = sled-agent/src/storage_monitor.rs:273 total duration = 220.713038265s
13982023-12-19T23:02:47.265ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_31bd71cd-4736-4a12-a387-9b74b050396f on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", model: "synthetic-model" } err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"cc8ee4cd-f446-4c16-97b7-fbbe16fcbc60\\", \\"content-length\\": \\"272\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:47 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: physical-disk with id \\\\\\"vendor = \\\\\\"synthetic-vendor\\\\\\", serial = \\\\\\"synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f\\\\\\", model = \\\\\\"synthetic-model\\\\\\"\\\\\\"\\", request_id: \\"cc8ee4cd-f446-4c16-97b7-fbbe16fcbc60\\" }" file = sled-agent/src/storage_monitor.rs:273 total duration = 220.716678855s
13992023-12-19T23:02:47.267ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"6ac0e69f-589b-4254-9bc2-8e71b5f106eb\\", \\"content-length\\": \\"272\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:47 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: physical-disk with id \\\\\\"vendor = \\\\\\"synthetic-vendor\\\\\\", serial = \\\\\\"synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b\\\\\\", model = \\\\\\"synthetic-model\\\\\\"\\\\\\"\\", request_id: \\"6ac0e69f-589b-4254-9bc2-8e71b5f106eb\\" }" file = sled-agent/src/storage_monitor.rs:273 total duration = 220.718758654s
14002023-12-19T23:02:47.312ZWARNSledAgent (StorageMonitor): failed to notify nexus about Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"dcbf4e72-8a2f-4d07-9833-92cfd283aafc\\", \\"content-length\\": \\"173\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:47 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: sled with id \\\\\\"097821eb-36d2-4a1a-98a7-92f64e03f037\\\\\\"\\", request_id: \\"dcbf4e72-8a2f-4d07-9833-92cfd283aafc\\" }" file = sled-agent/src/storage_monitor.rs:223 total duration = 220.765171826s
14012023-12-19T23:02:47.507ZINFOSledAgent (HardwareMonitor): contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "c42f8e572c524e4a95ee5da38884f6f2" } file = sled-agent/src/sled_agent.rs:637 id = 097821eb-36d2-4a1a-98a7-92f64e03f037
14022023-12-19T23:02:47.533ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"2f814249-f61e-4f09-a9f3-0c2c7a8f00b3\\", \\"content-length\\": \\"272\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:47 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: physical-disk with id \\\\\\"vendor = \\\\\\"synthetic-vendor\\\\\\", serial = \\\\\\"synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03\\\\\\", model = \\\\\\"synthetic-model\\\\\\"\\\\\\"\\", request_id: \\"2f814249-f61e-4f09-a9f3-0c2c7a8f00b3\\" }" file = sled-agent/src/storage_monitor.rs:273 total duration = 220.985523805s
14032023-12-19T23:02:47.566ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"4e62d734-adf6-4f49-b98b-cf0ba368f55e\\", \\"content-length\\": \\"272\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:47 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: physical-disk with id \\\\\\"vendor = \\\\\\"synthetic-vendor\\\\\\", serial = \\\\\\"synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03\\\\\\", model = \\\\\\"synthetic-model\\\\\\"\\\\\\"\\", request_id: \\"4e62d734-adf6-4f49-b98b-cf0ba368f55e\\" }" file = sled-agent/src/storage_monitor.rs:273 total duration = 221.016150499s
14042023-12-19T23:02:47.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34754
14052023-12-19T23:02:47.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34754 req_id = e7c0f10c-15c7-4904-8047-f07d3c880a0e response_code = 200 uri = /network-bootstore-config
14062023-12-19T23:02:48.001ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"d3c2f580-e3f0-460e-b355-7dd93cab2b92\\", \\"content-length\\": \\"272\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:47 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: physical-disk with id \\\\\\"vendor = \\\\\\"synthetic-vendor\\\\\\", serial = \\\\\\"synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b\\\\\\", model = \\\\\\"synthetic-model\\\\\\"\\\\\\"\\", request_id: \\"d3c2f580-e3f0-460e-b355-7dd93cab2b92\\" }" file = sled-agent/src/storage_monitor.rs:273 total duration = 221.45210989s
14072023-12-19T23:02:48.235ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"d4017da5-387b-47fa-acd6-9a975ffc6aba\\", \\"content-length\\": \\"272\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:48 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: physical-disk with id \\\\\\"vendor = \\\\\\"synthetic-vendor\\\\\\", serial = \\\\\\"synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03\\\\\\", model = \\\\\\"synthetic-model\\\\\\"\\\\\\"\\", request_id: \\"d4017da5-387b-47fa-acd6-9a975ffc6aba\\" }" file = sled-agent/src/storage_monitor.rs:273 total duration = 221.685412418s
14082023-12-19T23:02:48.542ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14092023-12-19T23:02:48.544ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "88a247c8-f8e7-4ed5-a77a-65acae1ce789", "content-length": "174", "date": "Tue, 19 Dec 2023 23:02:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"14b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "88a247c8-f8e7-4ed5-a77a-65acae1ce789" } file = sled-agent/src/rack_setup/service.rs:679
14102023-12-19T23:02:49.083ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e359dcfd-3c12-4163-957e-c9c90812cbea", "content-length": "174", "date": "Tue, 19 Dec 2023 23:02:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"14b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "e359dcfd-3c12-4163-957e-c9c90812cbea" } file = sled-agent/src/rack_setup/service.rs:679
14112023-12-19T23:02:49.256ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"b9f38e76-1dfd-4303-a6c8-07c1c3378dac\\", \\"content-length\\": \\"272\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:49 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: physical-disk with id \\\\\\"vendor = \\\\\\"synthetic-vendor\\\\\\", serial = \\\\\\"synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03\\\\\\", model = \\\\\\"synthetic-model\\\\\\"\\\\\\"\\", request_id: \\"b9f38e76-1dfd-4303-a6c8-07c1c3378dac\\" }" file = sled-agent/src/storage_monitor.rs:273 total duration = 222.707970725s
14122023-12-19T23:02:49.312ZINFOSledAgent (StorageMonitor): Nexus notification complete: Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) file = sled-agent/src/storage_monitor.rs:105
14132023-12-19T23:02:49.796ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3e88c1dc-5ed7-46cc-af37-cfad46b9de4c", "content-length": "174", "date": "Tue, 19 Dec 2023 23:02:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"14b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "3e88c1dc-5ed7-46cc-af37-cfad46b9de4c" } file = sled-agent/src/rack_setup/service.rs:679
14142023-12-19T23:02:50.516ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "32d14c0c-f951-4fe5-b403-392db3188f67", "content-length": "174", "date": "Tue, 19 Dec 2023 23:02:50 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"14b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "32d14c0c-f951-4fe5-b403-392db3188f67" } file = sled-agent/src/rack_setup/service.rs:679
14152023-12-19T23:02:50.985ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b83d0502-647c-4ecf-b6a9-e6342d9eacef", "content-length": "174", "date": "Tue, 19 Dec 2023 23:02:50 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"14b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "b83d0502-647c-4ecf-b6a9-e6342d9eacef" } file = sled-agent/src/rack_setup/service.rs:679
14162023-12-19T23:02:51.333ZINFOSledAgent (StorageMonitor): Nexus notification complete: Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) file = sled-agent/src/storage_monitor.rs:105
14172023-12-19T23:02:51.333ZINFOSledAgent (StorageMonitor): Nexus notification complete: Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) file = sled-agent/src/storage_monitor.rs:105
14182023-12-19T23:02:51.333ZINFOSledAgent (StorageMonitor): Nexus notification complete: Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) file = sled-agent/src/storage_monitor.rs:105
14192023-12-19T23:02:51.333ZINFOSledAgent (StorageMonitor): Nexus notification complete: Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: M2, vendor: "synthetic-vendor" }) file = sled-agent/src/storage_monitor.rs:105
14202023-12-19T23:02:51.333ZINFOSledAgent (StorageMonitor): Nexus notification complete: Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: M2, vendor: "synthetic-vendor" }) file = sled-agent/src/storage_monitor.rs:105
14212023-12-19T23:02:51.333ZINFOSledAgent (StorageMonitor): Nexus notification complete: Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) file = sled-agent/src/storage_monitor.rs:105
14222023-12-19T23:02:51.333ZINFOSledAgent (StorageMonitor): Nexus notification complete: Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) file = sled-agent/src/storage_monitor.rs:105
14232023-12-19T23:02:52.022ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b72e23f3-23d2-4d62-8e34-a972a0758eda", "content-length": "174", "date": "Tue, 19 Dec 2023 23:02:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"14b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "b72e23f3-23d2-4d62-8e34-a972a0758eda" } file = sled-agent/src/rack_setup/service.rs:679
14242023-12-19T23:02:52.105ZWARNSledAgent (StorageMonitor): failed to notify nexus about a new pool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } err = "Error Response: status: 404 Not Found; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"629593e7-982b-4a90-a0de-0e5a6b3a82bd\\", \\"content-length\\": \\"272\\", \\"date\\": \\"Tue, 19 Dec 2023 23:02:51 GMT\\"}; value: Error { error_code: Some(\\"ObjectNotFound\\"), message: \\"not found: physical-disk with id \\\\\\"vendor = \\\\\\"synthetic-vendor\\\\\\", serial = \\\\\\"synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03\\\\\\", model = \\\\\\"synthetic-model\\\\\\"\\\\\\"\\", request_id: \\"629593e7-982b-4a90-a0de-0e5a6b3a82bd\\" }" file = sled-agent/src/storage_monitor.rs:273 total duration = 225.555715013s
14252023-12-19T23:02:53.082ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a4d15bfc-820f-4b01-bc77-40f09e9aa129", "content-length": "174", "date": "Tue, 19 Dec 2023 23:02:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"14b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "a4d15bfc-820f-4b01-bc77-40f09e9aa129" } file = sled-agent/src/rack_setup/service.rs:679
14262023-12-19T23:02:53.232ZINFOSledAgent (StorageMonitor): Nexus notification complete: Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) file = sled-agent/src/storage_monitor.rs:105
14272023-12-19T23:02:53.232ZINFOSledAgent (StorageMonitor): Nexus notification complete: Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) file = sled-agent/src/storage_monitor.rs:105
14282023-12-19T23:02:53.544ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14292023-12-19T23:02:53.787ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "26f79d5f-6ea7-4d0a-8f2c-d05a594be3d2", "content-length": "174", "date": "Tue, 19 Dec 2023 23:02:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"14b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "26f79d5f-6ea7-4d0a-8f2c-d05a594be3d2" } file = sled-agent/src/rack_setup/service.rs:679
14302023-12-19T23:02:54.865ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5bffd193-a324-403c-8117-9c5b2dc9c6ac", "content-length": "174", "date": "Tue, 19 Dec 2023 23:02:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"14b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "5bffd193-a324-403c-8117-9c5b2dc9c6ac" } file = sled-agent/src/rack_setup/service.rs:679
14312023-12-19T23:02:55.334ZINFOSledAgent (StorageMonitor): Nexus notification complete: Put(PhysicalDiskPutRequest { model: "synthetic-model", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", sled_id: 097821eb-36d2-4a1a-98a7-92f64e03f037, variant: U2, vendor: "synthetic-vendor" }) file = sled-agent/src/storage_monitor.rs:105
14322023-12-19T23:02:55.334ZINFOSledAgent (StorageMonitor): Nexus notification complete: ZpoolPutRequest { disk_model: "synthetic-model", disk_serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", disk_vendor: "synthetic-vendor", size: ByteCount(20937965568) } file = sled-agent/src/storage_monitor.rs:105
14332023-12-19T23:02:55.334ZINFOSledAgent (StorageMonitor): Nexus notification complete: ZpoolPutRequest { disk_model: "synthetic-model", disk_serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", disk_vendor: "synthetic-vendor", size: ByteCount(20937965568) } file = sled-agent/src/storage_monitor.rs:105
14342023-12-19T23:02:55.334ZINFOSledAgent (StorageMonitor): Nexus notification complete: ZpoolPutRequest { disk_model: "synthetic-model", disk_serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", disk_vendor: "synthetic-vendor", size: ByteCount(20937965568) } file = sled-agent/src/storage_monitor.rs:105
14352023-12-19T23:02:55.334ZINFOSledAgent (StorageMonitor): Nexus notification complete: ZpoolPutRequest { disk_model: "synthetic-model", disk_serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", disk_vendor: "synthetic-vendor", size: ByteCount(20937965568) } file = sled-agent/src/storage_monitor.rs:105
14362023-12-19T23:02:55.334ZINFOSledAgent (StorageMonitor): Nexus notification complete: ZpoolPutRequest { disk_model: "synthetic-model", disk_serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", disk_vendor: "synthetic-vendor", size: ByteCount(20937965568) } file = sled-agent/src/storage_monitor.rs:105
14372023-12-19T23:02:55.334ZINFOSledAgent (StorageMonitor): Nexus notification complete: ZpoolPutRequest { disk_model: "synthetic-model", disk_serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", disk_vendor: "synthetic-vendor", size: ByteCount(20937965568) } file = sled-agent/src/storage_monitor.rs:105
14382023-12-19T23:02:55.334ZINFOSledAgent (StorageMonitor): Nexus notification complete: ZpoolPutRequest { disk_model: "synthetic-model", disk_serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", disk_vendor: "synthetic-vendor", size: ByteCount(20937965568) } file = sled-agent/src/storage_monitor.rs:105
14392023-12-19T23:02:55.334ZINFOSledAgent (StorageMonitor): Nexus notification complete: ZpoolPutRequest { disk_model: "synthetic-model", disk_serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", disk_vendor: "synthetic-vendor", size: ByteCount(20937965568) } file = sled-agent/src/storage_monitor.rs:105
14402023-12-19T23:02:55.334ZINFOSledAgent (StorageMonitor): Nexus notification complete: ZpoolPutRequest { disk_model: "synthetic-model", disk_serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", disk_vendor: "synthetic-vendor", size: ByteCount(20937965568) } file = sled-agent/src/storage_monitor.rs:105
14412023-12-19T23:02:55.334ZINFOSledAgent (StorageMonitor): Nexus notification complete: ZpoolPutRequest { disk_model: "synthetic-model", disk_serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", disk_vendor: "synthetic-vendor", size: ByteCount(20937965568) } file = sled-agent/src/storage_monitor.rs:105
14422023-12-19T23:02:56.247ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "16980426-7bd8-43d1-a680-bb34861e0742", "content-length": "174", "date": "Tue, 19 Dec 2023 23:02:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"f4b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "16980426-7bd8-43d1-a680-bb34861e0742" } file = sled-agent/src/rack_setup/service.rs:679
14432023-12-19T23:02:56.260ZINFOSledAgent (StorageMonitor): Nexus notification complete: ZpoolPutRequest { disk_model: "synthetic-model", disk_serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", disk_vendor: "synthetic-vendor", size: ByteCount(20937965568) } file = sled-agent/src/storage_monitor.rs:105
14442023-12-19T23:02:57.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51427
14452023-12-19T23:02:57.512ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:412 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5d97d1ac-59e1-4ee6-8a5a-49d048efbba6, kind: Service { id: d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e }, name: Name("external-dns-d7bbc3bb-0141-4d4b-a0e2-3d6705e0483e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 102])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 70d944ff-b091-4f45-a71a-1735c343e70a, kind: Service { id: 93d69613-245d-4c9d-bfae-666f10c736c7 }, name: Name("external-dns-93d69613-245d-4c9d-bfae-666f10c736c7"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 134])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 146a0e88-01cd-4798-9a68-1d0d4d4898a9, kind: Service { id: 22feef1b-3641-4f5b-812a-6e074694eb5c }, name: Name("nexus-22feef1b-3641-4f5b-812a-6e074694eb5c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 116])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 50985ea0-d0b9-4e0a-ac85-ca7e868331f5, kind: Service { id: 84fda2b6-423e-4cf4-9244-a7408c62a861 }, name: Name("nexus-84fda2b6-423e-4cf4-9244-a7408c62a861"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 5])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: abda11aa-c7c1-4cc3-92a2-99b94f3157f0, kind: Service { id: 38b01531-4202-4bd1-aa60-b1a0d98599e3 }, name: Name("nexus-38b01531-4202-4bd1-aa60-b1a0d98599e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 117])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14462023-12-19T23:02:57.512ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:431 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14472023-12-19T23:02:57.512ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:431 port = "opte0" rules = []
14482023-12-19T23:02:57.512ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:431 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14492023-12-19T23:02:57.512ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:431 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14502023-12-19T23:02:57.512ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:431 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14512023-12-19T23:02:57.512ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:431 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14522023-12-19T23:02:57.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51427 req_id = ae054187-0a97-4e3f-8f2c-86e8dedca158 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14532023-12-19T23:02:57.710ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:689
14542023-12-19T23:02:58.545ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14552023-12-19T23:03:01.048ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62654
14562023-12-19T23:03:01.049ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 279 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62654 req_id = b1c4f565-a338-486f-80d8-27b3d7d67914 response_code = 200 uri = /baseboard
14572023-12-19T23:03:03.547ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14582023-12-19T23:03:08.548ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14592023-12-19T23:03:13.550ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14602023-12-19T23:03:18.551ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14612023-12-19T23:03:23.554ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14622023-12-19T23:03:28.556ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14632023-12-19T23:03:31.090ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57617
14642023-12-19T23:03:31.090ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57617 req_id = 4b30f124-1d14-4059-9351-fc221dc08c31 response_code = 200 uri = /baseboard
14652023-12-19T23:03:33.558ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14662023-12-19T23:03:33.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::d]:36647
14672023-12-19T23:03:33.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 3155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = 854c62aa-1eb9-4649-94f4-4fc2284655aa response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
14682023-12-19T23:03:38.560ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14692023-12-19T23:03:43.562ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14702023-12-19T23:03:48.563ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14712023-12-19T23:03:53.564ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14722023-12-19T23:03:58.565ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14732023-12-19T23:04:01.123ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53141
14742023-12-19T23:04:01.124ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 196 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53141 req_id = ffc6c519-9f5f-4198-9604-3fd989b46da4 response_code = 200 uri = /baseboard
14752023-12-19T23:04:03.566ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14762023-12-19T23:04:03.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 604 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = b8d761e7-5626-453a-a66b-907e9c002406 response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
14772023-12-19T23:04:03.781ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:532
14782023-12-19T23:04:08.568ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14792023-12-19T23:04:13.570ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14802023-12-19T23:04:18.570ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14812023-12-19T23:04:23.572ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14822023-12-19T23:04:28.573ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14832023-12-19T23:04:31.158ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59822
14842023-12-19T23:04:31.158ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59822 req_id = 6c204426-f6cb-4fb1-89b1-0bb81e9fe8f0 response_code = 200 uri = /baseboard
14852023-12-19T23:04:33.574ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14862023-12-19T23:04:33.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = 641ca835-9b95-4612-b0fe-014570512902 response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
14872023-12-19T23:04:38.575ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14882023-12-19T23:04:43.576ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14892023-12-19T23:04:48.577ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14902023-12-19T23:04:53.579ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14912023-12-19T23:04:58.580ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14922023-12-19T23:05:01.192ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38098
14932023-12-19T23:05:01.192ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38098 req_id = ed9c8385-0416-4195-b0c2-66802966cdd5 response_code = 200 uri = /baseboard
14942023-12-19T23:05:03.581ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14952023-12-19T23:05:03.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = 5dbd5d65-b6b6-437e-addf-3eeeb6f7424a response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
14962023-12-19T23:05:08.582ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14972023-12-19T23:05:13.583ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14982023-12-19T23:05:18.584ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
14992023-12-19T23:05:23.586ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15002023-12-19T23:05:28.587ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15012023-12-19T23:05:31.225ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41277
15022023-12-19T23:05:31.225ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41277 req_id = 79a5333f-e7a7-4ddb-a25c-a3275c3e7412 response_code = 200 uri = /baseboard
15032023-12-19T23:05:33.588ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15042023-12-19T23:05:33.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = dca5695a-93a3-49e9-bfba-d857dee36922 response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
15052023-12-19T23:05:38.590ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15062023-12-19T23:05:43.592ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15072023-12-19T23:05:48.593ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15082023-12-19T23:05:53.595ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15092023-12-19T23:05:58.596ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15102023-12-19T23:06:01.258ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41045
15112023-12-19T23:06:01.258ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41045 req_id = 00e2b4b9-98d7-4e38-b1ef-597e7920a043 response_code = 200 uri = /baseboard
15122023-12-19T23:06:03.597ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15132023-12-19T23:06:03.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 654 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = 6051a42c-9342-4bee-be6f-847503870959 response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
15142023-12-19T23:06:08.599ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15152023-12-19T23:06:13.600ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15162023-12-19T23:06:18.601ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15172023-12-19T23:06:23.604ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15182023-12-19T23:06:28.604ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15192023-12-19T23:06:31.292ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64139
15202023-12-19T23:06:31.292ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64139 req_id = 74b6b8ec-253c-4c80-9d52-98722f9be30b response_code = 200 uri = /baseboard
15212023-12-19T23:06:33.607ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15222023-12-19T23:06:33.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = 1cfed9e8-5914-4e2f-bf49-7267df468cf0 response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
15232023-12-19T23:06:38.608ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15242023-12-19T23:06:43.610ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15252023-12-19T23:06:48.612ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15262023-12-19T23:06:53.614ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15272023-12-19T23:06:58.615ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15282023-12-19T23:07:01.327ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52219
15292023-12-19T23:07:01.327ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52219 req_id = f99ef825-ce2c-4480-ace6-8508b0cb9c47 response_code = 200 uri = /baseboard
15302023-12-19T23:07:03.616ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15312023-12-19T23:07:03.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = c93dc3dd-f06b-42e6-8156-3520402f5897 response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
15322023-12-19T23:07:08.617ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15332023-12-19T23:07:13.619ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15342023-12-19T23:07:18.620ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15352023-12-19T23:07:23.623ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15362023-12-19T23:07:28.624ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15372023-12-19T23:07:31.362ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34982
15382023-12-19T23:07:31.362ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34982 req_id = ac45625d-661b-4ddb-8cac-6523132e11ab response_code = 200 uri = /baseboard
15392023-12-19T23:07:33.626ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15402023-12-19T23:07:33.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = 445ddc67-eb8d-4d74-af68-3d18e2bae0a8 response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
15412023-12-19T23:07:38.628ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15422023-12-19T23:07:43.629ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15432023-12-19T23:07:48.631ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15442023-12-19T23:07:53.633ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15452023-12-19T23:07:58.634ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15462023-12-19T23:08:01.395ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44267
15472023-12-19T23:08:01.395ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44267 req_id = 27248de6-414f-4100-883e-c41dc1e1a84d response_code = 200 uri = /baseboard
15482023-12-19T23:08:03.635ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15492023-12-19T23:08:03.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = 7b8e859b-370b-4a9b-b77d-e1e95065ef86 response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
15502023-12-19T23:08:08.637ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15512023-12-19T23:08:13.639ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15522023-12-19T23:08:18.640ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15532023-12-19T23:08:23.640ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15542023-12-19T23:08:28.641ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15552023-12-19T23:08:31.429ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48728
15562023-12-19T23:08:31.429ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48728 req_id = 289e000b-cbea-4db9-bdfe-56756faccbb4 response_code = 200 uri = /baseboard
15572023-12-19T23:08:33.642ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15582023-12-19T23:08:33.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = f63c1064-04bb-4184-be4b-2325e9f962ee response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
15592023-12-19T23:08:38.645ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15602023-12-19T23:08:43.647ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15612023-12-19T23:08:48.648ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15622023-12-19T23:08:53.650ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15632023-12-19T23:08:58.652ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15642023-12-19T23:09:01.461ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36749
15652023-12-19T23:09:01.461ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36749 req_id = 55b38fdb-1e7e-462d-b20e-0a7bd5ad8c9d response_code = 200 uri = /baseboard
15662023-12-19T23:09:03.654ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15672023-12-19T23:09:03.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = a35f5e27-7bbd-469a-96e7-910da4aca416 response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
15682023-12-19T23:09:03.782ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:532
15692023-12-19T23:09:04.074ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:299
15702023-12-19T23:09:04.074ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
15712023-12-19T23:09:04.115ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:288 next_cleanup = Instant { tv_sec: 5286, tv_nsec: 180564664 } time_to_next_cleanup = 599.99999579s
15722023-12-19T23:09:08.656ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15732023-12-19T23:09:13.658ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15742023-12-19T23:09:18.658ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15752023-12-19T23:09:21.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62539
15762023-12-19T23:09:21.365ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:227 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: "localshark" }, nics: [NetworkInterface { id: 4709ff63-ce2f-4a73-af66-73fff410b0a6, kind: Instance { id: f7f30827-7e60-46f8-a5f6-5bdab286fef9 }, name: Name("net0"), ip: 172.30.0.6, mac: MacAddr(MacAddr6([168, 64, 37, 244, 150, 117])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(25435), primary: true, slot: 1 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4709ff63-ce2f-4a73-af66-73fff410b0a6, kind: Instance { id: f7f30827-7e60-46f8-a5f6-5bdab286fef9 }, name: Name("net0"), ip: 172.30.0.6, mac: MacAddr(MacAddr6([168, 64, 37, 244, 150, 117])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(25435), primary: true, slot: 1 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4709ff63-ce2f-4a73-af66-73fff410b0a6, kind: Instance { id: f7f30827-7e60-46f8-a5f6-5bdab286fef9 }, name: Name("net0"), ip: 172.30.0.6, mac: MacAddr(MacAddr6([168, 64, 37, 244, 150, 117])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(25435), primary: true, slot: 1 }], filter_hosts: Some([Vpc(Vni(25435))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4709ff63-ce2f-4a73-af66-73fff410b0a6, kind: Instance { id: f7f30827-7e60-46f8-a5f6-5bdab286fef9 }, name: Name("net0"), ip: 172.30.0.6, mac: MacAddr(MacAddr6([168, 64, 37, 244, 150, 117])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(25435), primary: true, slot: 1 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-1afebeadc1", read_only: false, slot: Slot(1), volume_construction_request: Volume { block_size: 512, id: b45889ea-d365-4022-aae8-2ea93511917c, read_only_parent: Some(Volume { block_size: 512, id: dddbab3b-bdea-4466-9b32-bc54511dce16, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7b99cfb6-6389-42e5-a36d-223164fb6ded, key: Some("ghNi2gYpfmb4sz1XR0LzASG2U8YckipfZnXQoXkw+H8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b45889ea-d365-4022-aae8-2ea93511917c, key: Some("pW6vqzY0uSZwYQutiKadUSP8Yd+bv+P7WyfpwLcnf3I="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::15]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAACEKrmTV5NXAAAquZNXAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAhCq5k1eTVwAAKrmTVwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJmN2YzMDgyNy03ZTYwLTQ2ZjgtYTVmNi01YmRhYjI4NmZlZjkiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJRjVWYm53bG41RGJmeDFtVUNUeThCQk90YllIaEo1UDB0QVR4SndRVTU5MiJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 instance_runtime = InstanceRuntimeState { propolis_id: Some(b512c169-f956-48df-b190-9141d99fdbc7), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2023-12-19T23:09:20.996068456Z } propolis_addr = [fd00:1122:3344:101::22]:12400 propolis_id = b512c169-f956-48df-b190-9141d99fdbc7 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2023-12-19T23:09:20.943849Z }
15772023-12-19T23:09:21.365ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:261 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
15782023-12-19T23:09:21.365ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:600 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 propolis_id = b512c169-f956-48df-b190-9141d99fdbc7 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: "localshark" }, nics: [NetworkInterface { id: 4709ff63-ce2f-4a73-af66-73fff410b0a6, kind: Instance { id: f7f30827-7e60-46f8-a5f6-5bdab286fef9 }, name: Name("net0"), ip: 172.30.0.6, mac: MacAddr(MacAddr6([168, 64, 37, 244, 150, 117])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(25435), primary: true, slot: 1 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4709ff63-ce2f-4a73-af66-73fff410b0a6, kind: Instance { id: f7f30827-7e60-46f8-a5f6-5bdab286fef9 }, name: Name("net0"), ip: 172.30.0.6, mac: MacAddr(MacAddr6([168, 64, 37, 244, 150, 117])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(25435), primary: true, slot: 1 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4709ff63-ce2f-4a73-af66-73fff410b0a6, kind: Instance { id: f7f30827-7e60-46f8-a5f6-5bdab286fef9 }, name: Name("net0"), ip: 172.30.0.6, mac: MacAddr(MacAddr6([168, 64, 37, 244, 150, 117])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(25435), primary: true, slot: 1 }], filter_hosts: Some([Vpc(Vni(25435))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4709ff63-ce2f-4a73-af66-73fff410b0a6, kind: Instance { id: f7f30827-7e60-46f8-a5f6-5bdab286fef9 }, name: Name("net0"), ip: 172.30.0.6, mac: MacAddr(MacAddr6([168, 64, 37, 244, 150, 117])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(25435), primary: true, slot: 1 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-1afebeadc1", read_only: false, slot: Slot(1), volume_construction_request: Volume { block_size: 512, id: b45889ea-d365-4022-aae8-2ea93511917c, read_only_parent: Some(Volume { block_size: 512, id: dddbab3b-bdea-4466-9b32-bc54511dce16, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7b99cfb6-6389-42e5-a36d-223164fb6ded, key: Some("ghNi2gYpfmb4sz1XR0LzASG2U8YckipfZnXQoXkw+H8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b45889ea-d365-4022-aae8-2ea93511917c, key: Some("pW6vqzY0uSZwYQutiKadUSP8Yd+bv+P7WyfpwLcnf3I="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::15]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAACEKrmTV5NXAAAquZNXAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAhCq5k1eTVwAAKrmTVwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJmN2YzMDgyNy03ZTYwLTQ2ZjgtYTVmNi01YmRhYjI4NmZlZjkiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJRjVWYm53bG41RGJmeDFtVUNUeThCQk90YllIaEo1UDB0QVR4SndRVTU5MiJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(b512c169-f956-48df-b190-9141d99fdbc7), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2023-12-19T23:09:20.996068456Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2023-12-19T23:09:20.943849Z }, propolis_addr: [fd00:1122:3344:101::22]:12400 }
15792023-12-19T23:09:21.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 5716 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62539 req_id = dd58b978-d3af-4df0-a823-08ddb128d102 response_code = 200 uri = /instances/f7f30827-7e60-46f8-a5f6-5bdab286fef9
15802023-12-19T23:09:21.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36437
15812023-12-19T23:09:21.507ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:396 port = Port { inner: PortInner { name: "opte6", _ip: 172.30.0.6, mac: MacAddr6([168, 64, 37, 244, 150, 117]), slot: 1, vni: Vni { inner: 25435 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
15822023-12-19T23:09:21.507ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
15832023-12-19T23:09:21.541ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7 file = illumos-utils/src/zone.rs:314 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
15842023-12-19T23:09:21.562ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7 file = illumos-utils/src/zone.rs:353 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
15852023-12-19T23:09:23.255ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::22"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::a]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
15862023-12-19T23:09:23.255ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:512 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 zone = oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7
15872023-12-19T23:09:23.429ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 32.559979ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 zone = oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7
15882023-12-19T23:09:23.470ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 110.806313ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 zone = oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7
15892023-12-19T23:09:23.594ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 254.688069ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 zone = oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7
15902023-12-19T23:09:23.660ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
15912023-12-19T23:09:23.862ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 529.040025ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 zone = oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7
15922023-12-19T23:09:24.403ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 807.080033ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 zone = oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7
15932023-12-19T23:09:25.221ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 653.620246ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 zone = oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7
15942023-12-19T23:09:25.886ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 743.100953ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 zone = oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7
15952023-12-19T23:09:26.640ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 900.534894ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 zone = oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7
15962023-12-19T23:09:27.550ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 714.274312ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 zone = oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7
15972023-12-19T23:09:28.293ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7 file = sled-agent/src/instance.rs:991 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
15982023-12-19T23:09:28.301ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 59.405798ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
15992023-12-19T23:09:28.370ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 74.473572ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16002023-12-19T23:09:28.454ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7") failed: Property not found. retry in 129.40626ms file = illumos-utils/src/svc.rs:36 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16012023-12-19T23:09:28.594ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1000 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16022023-12-19T23:09:28.630ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1014 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16032023-12-19T23:09:28.631ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAACEKrmTV5NXAAAquZNXAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAhCq5k1eTVwAAKrmTVwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJmN2YzMDgyNy03ZTYwLTQ2ZjgtYTVmNi01YmRhYjI4NmZlZjkiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJRjVWYm53bG41RGJmeDFtVUNUeThCQk90YllIaEo1UDB0QVR4SndRVTU5MiJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-1afebeadc1", read_only: false, slot: Slot(1), volume_construction_request: Volume { block_size: 512, id: b45889ea-d365-4022-aae8-2ea93511917c, read_only_parent: Some(Volume { block_size: 512, id: dddbab3b-bdea-4466-9b32-bc54511dce16, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 7b99cfb6-6389-42e5-a36d-223164fb6ded, key: Some("ghNi2gYpfmb4sz1XR0LzASG2U8YckipfZnXQoXkw+H8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b45889ea-d365-4022-aae8-2ea93511917c, key: Some("pW6vqzY0uSZwYQutiKadUSP8Yd+bv+P7WyfpwLcnf3I="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::15]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(1) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: f7f30827-7e60-46f8-a5f6-5bdab286fef9, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:451 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16042023-12-19T23:09:28.662ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
16052023-12-19T23:09:28.818ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:453 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16062023-12-19T23:09:28.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 7335579 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36437 req_id = 43fc18ae-4c68-40fc-9bc8-6ce69ed9fb08 response_code = 200 uri = /instances/f7f30827-7e60-46f8-a5f6-5bdab286fef9/state
16072023-12-19T23:09:28.819ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2023-12-19T23:09:28.818981596Z } file = sled-agent/src/instance.rs:335 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16082023-12-19T23:09:28.819ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:357 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 new_instance_state = InstanceRuntimeState { propolis_id: Some(b512c169-f956-48df-b190-9141d99fdbc7), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2023-12-19T23:09:20.996068456Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2023-12-19T23:09:28.818981596Z } propolis_id = b512c169-f956-48df-b190-9141d99fdbc7
16092023-12-19T23:09:28.819ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:260 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(b512c169-f956-48df-b190-9141d99fdbc7), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2023-12-19T23:09:20.996068456Z }, propolis_id: b512c169-f956-48df-b190-9141d99fdbc7, vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2023-12-19T23:09:28.818981596Z } }
16102023-12-19T23:09:28.885ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2023-12-19T23:09:28.885353073Z } file = sled-agent/src/instance.rs:335 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16112023-12-19T23:09:28.885ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:357 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 new_instance_state = InstanceRuntimeState { propolis_id: Some(b512c169-f956-48df-b190-9141d99fdbc7), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2023-12-19T23:09:20.996068456Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2023-12-19T23:09:28.885353073Z } propolis_id = b512c169-f956-48df-b190-9141d99fdbc7
16122023-12-19T23:09:28.885ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:260 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(b512c169-f956-48df-b190-9141d99fdbc7), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2023-12-19T23:09:20.996068456Z }, propolis_id: b512c169-f956-48df-b190-9141d99fdbc7, vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2023-12-19T23:09:28.885353073Z } }
16132023-12-19T23:09:31.493ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61270
16142023-12-19T23:09:31.494ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61270 req_id = 1294facd-73ec-4fee-8061-9670f78c09e0 response_code = 200 uri = /baseboard
16152023-12-19T23:09:33.663ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
16162023-12-19T23:09:33.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::d]:36647 req_id = 49a9f594-5560-4c78-8b46-366c2a7d1a26 response_code = 200 uri = /metrics/collect/097821eb-36d2-4a1a-98a7-92f64e03f037
16172023-12-19T23:09:38.665ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
16182023-12-19T23:09:43.666ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
16192023-12-19T23:09:46.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41207
16202023-12-19T23:09:46.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 999 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41207 req_id = 9fabe8ee-48a0-432b-b54f-6f59b253528c response_code = 200 uri = /instances/f7f30827-7e60-46f8-a5f6-5bdab286fef9/state
16212023-12-19T23:09:46.072ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2023-12-19T23:09:46.072016890Z } file = sled-agent/src/instance.rs:335 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16222023-12-19T23:09:46.072ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:357 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 new_instance_state = InstanceRuntimeState { propolis_id: Some(b512c169-f956-48df-b190-9141d99fdbc7), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2023-12-19T23:09:20.996068456Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2023-12-19T23:09:46.072016890Z } propolis_id = b512c169-f956-48df-b190-9141d99fdbc7
16232023-12-19T23:09:46.072ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:260 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(b512c169-f956-48df-b190-9141d99fdbc7), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2023-12-19T23:09:20.996068456Z }, propolis_id: b512c169-f956-48df-b190-9141d99fdbc7, vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2023-12-19T23:09:46.072016890Z } }
16242023-12-19T23:09:46.121ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopped), migration_status: NoMigration, time: 2023-12-19T23:09:46.121038688Z } file = sled-agent/src/instance.rs:335 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16252023-12-19T23:09:46.121ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:357 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 new_instance_state = InstanceRuntimeState { propolis_id: Some(b512c169-f956-48df-b190-9141d99fdbc7), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2023-12-19T23:09:20.996068456Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2023-12-19T23:09:46.121038688Z } propolis_id = b512c169-f956-48df-b190-9141d99fdbc7
16262023-12-19T23:09:46.121ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:260 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(b512c169-f956-48df-b190-9141d99fdbc7), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2023-12-19T23:09:20.996068456Z }, propolis_id: b512c169-f956-48df-b190-9141d99fdbc7, vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2023-12-19T23:09:46.121038688Z } }
16272023-12-19T23:09:46.250ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2023-12-19T23:09:46.250956886Z } file = sled-agent/src/instance.rs:335 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16282023-12-19T23:09:46.251ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:357 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2023-12-19T23:09:46.250956886Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2023-12-19T23:09:46.250956886Z } propolis_id = b512c169-f956-48df-b190-9141d99fdbc7
16292023-12-19T23:09:46.251ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:372 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16302023-12-19T23:09:46.251ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
16312023-12-19T23:09:46.251ZINFOSledAgent (StorageManager): Received GetLatestResources(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) }) file = sled-storage/src/manager.rs:346
16322023-12-19T23:09:46.251ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/debug/bundle/zone", "/pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug", "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug", "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/debug", "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/debug", "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/debug", "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/debug", "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/debug", "/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug", "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:436 zone_name = oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7
16332023-12-19T23:09:46.856ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1229 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7", bundle_id: 20f02926-8b61-4094-bea4-343999347379 }, time_created: 2023-12-19T23:09:46.251458723Z, version: 0, cause: TerminatedInstance }
16342023-12-19T23:09:46.857ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_b512c169-f956-48df-b190-9141d99fdbc7 file = sled-agent/src/instance.rs:545 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16352023-12-19T23:09:48.447ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:268 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9
16362023-12-19T23:09:48.480ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:260 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2023-12-19T23:09:46.250956886Z }, propolis_id: b512c169-f956-48df-b190-9141d99fdbc7, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2023-12-19T23:09:46.250956886Z } }
16372023-12-19T23:09:48.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57911
16382023-12-19T23:09:48.579ZWARNSledAgent (PortManager): unset_virtual_nic_host unimplmented file = illumos-utils/src/opte/port_manager.rs:507
16392023-12-19T23:09:48.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/ff87a01/dropshot/src/server.rs:853 latency_us = 1047 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:57911 req_id = 69b45f8f-1dfe-49aa-a4cc-6d6a8d6bfea4 response_code = 204 uri = /v2p/4709ff63-ce2f-4a73-af66-73fff410b0a6
16402023-12-19T23:09:48.669ZINFOSledAgent (bootstore_ddmd_poller): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::f827:20ff:fec0:57d0": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
16412023-12-19T23:09:48.763ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:488 instance_id = f7f30827-7e60-46f8-a5f6-5bdab286fef9