Max level shown:
1 [ Sep 20 03:48:28 Enabled. ]
2 [ Sep 20 03:48:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Sep 20 03:48:28 Method "start" exited with status 0. ]
4 [ Sep 20 03:48:28 Rereading configuration. ]
5 [ Sep 20 03:48:28 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72023-09-20T03:48:28.907ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:348
82023-09-20T03:48:28.909ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
92023-09-20T03:48:29.019ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
102023-09-20T03:48:29.028ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
112023-09-20T03:48:29.036ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:358 path = /var/run/oxide/
122023-09-20T03:48:29.642ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:9fb2::, len: 64 }
132023-09-20T03:48:29.784ZINFOSledAgent (BootstrapAgentStartup): Starting hardware monitor file = sled-agent/src/bootstrap/pre_server.rs:215 sled_mode = Scrimlet { asic: SoftNpu }
142023-09-20T03:48:29.784ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:607
152023-09-20T03:48:29.787ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "602813a976bb46b796470e81b87765e9", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:533
162023-09-20T03:48:29.787ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:653
172023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Upserting synthetic zpool to Storage Manager: oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b file = sled-agent/src/bootstrap/pre_server.rs:395
182023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Upserting synthetic zpool to Storage Manager: oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b file = sled-agent/src/bootstrap/pre_server.rs:395
192023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Upserting synthetic zpool to Storage Manager: oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b file = sled-agent/src/bootstrap/pre_server.rs:395
202023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Upserting synthetic zpool to Storage Manager: oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 file = sled-agent/src/bootstrap/pre_server.rs:395
212023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Upserting synthetic zpool to Storage Manager: oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 file = sled-agent/src/bootstrap/pre_server.rs:395
222023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Upserting synthetic zpool to Storage Manager: oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 file = sled-agent/src/bootstrap/pre_server.rs:395
232023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Upserting synthetic zpool to Storage Manager: oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 file = sled-agent/src/bootstrap/pre_server.rs:395
242023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Upserting synthetic zpool to Storage Manager: oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 file = sled-agent/src/bootstrap/pre_server.rs:395
252023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Upserting synthetic zpool to Storage Manager: oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 file = sled-agent/src/bootstrap/pre_server.rs:395
262023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Upserting synthetic zpool to Storage Manager: oxp_31bd71cd-4736-4a12-a387-9b74b050396f file = sled-agent/src/bootstrap/pre_server.rs:395
272023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Upserting synthetic zpool to Storage Manager: oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 file = sled-agent/src/bootstrap/pre_server.rs:395
282023-09-20T03:48:29.787ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:221 next_cleanup = Instant { tv_sec: 1128, tv_nsec: 961714901 } time_to_next_cleanup = 599.999946819s
292023-09-20T03:48:29.787ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:711
302023-09-20T03:48:29.787ZINFOSledAgent (BootstrapAgentStartup): Checking current full hardware snapshot file = sled-agent/src/bootstrap/pre_server.rs:119 underlay_network_info = None
312023-09-20T03:48:29.787ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:2439
322023-09-20T03:48:29.792ZINFOSledAgent (DumpSetup-archival): DumpSetup poll loop started. file = sled-agent/src/storage/dump_setup.rs:169
332023-09-20T03:48:29.792ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/storage/dump_setup.rs:530
342023-09-20T03:48:29.792ZINFOSledAgent (StorageManager): Upserting synthetic disk for: ZpoolName { id: a462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal } file = sled-agent/src/storage_manager.rs:770
352023-09-20T03:48:29.797ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:2654
362023-09-20T03:48:29.797ZINFOSledAgent (BootstrapAgentStartup): Waiting for boot disk M.2... file = sled-agent/src/bootstrap/server.rs:541
372023-09-20T03:48:29.858ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:314
382023-09-20T03:48:29.876ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:353
392023-09-20T03:48:30.012ZINFOSledAgent (StorageManager): Storage manager processing zpool: ZpoolInfo { name: "oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b", size: 20937965568, allocated: 454656, free: 20937510912, health: Online, } file = sled-agent/src/storage_manager.rs:988
402023-09-20T03:48:30.012ZINFOSledAgent (StorageManager): Upserting synthetic disk for: ZpoolName { id: b462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal } file = sled-agent/src/storage_manager.rs:770
412023-09-20T03:48:30.049ZINFOSledAgent (BootstrapAgentStartup): Found boot disk M.2: (DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, ZpoolName { id: a462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: Internal }) file = sled-agent/src/bootstrap/server.rs:537
422023-09-20T03:48:30.049ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-602813a976bb46b796470e81b87765e9-i86pc
432023-09-20T03:48:30.049ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-602813a976bb46b796470e81b87765e9-i86pc
442023-09-20T03:48:30.050ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:195 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
452023-09-20T03:48:30.050ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
462023-09-20T03:48:30.050ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { rack_subnet: fd00:1122:3344:100::, trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: Some( RackNetworkConfig { infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, uplinks: [ UplinkConfig { gateway_ip: 10.151.1.100, switch: Switch0, uplink_port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, uplink_cidr: Ipv4Network { addr: 10.151.1.174, prefix: 32, }, uplink_vid: None, }, ], }, ), } file = sled-agent/src/rack_setup/service.rs:746
472023-09-20T03:48:30.050ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
482023-09-20T03:48:30.050ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {}
492023-09-20T03:48:30.050ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:805
502023-09-20T03:48:30.050ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:846
512023-09-20T03:48:30.050ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:112
522023-09-20T03:48:30.050ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:88
532023-09-20T03:48:30.051ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:131
542023-09-20T03:48:30.051ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:877
552023-09-20T03:48:30.051ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:534 peer_id = pc-602813a976bb46b796470e81b87765e9-i86pc
562023-09-20T03:48:30.051ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:618 peer_id = pc-602813a976bb46b796470e81b87765e9-i86pc
572023-09-20T03:48:30.051ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { id: 964838d7-ad13-4f5c-8503-dad6ebc26cf6, rack_id: 0cf2e290-a977-4efb-a951-606f600e35e9, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], use_trust_quorum: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
582023-09-20T03:48:30.051ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:60994
592023-09-20T03:48:30.051ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { id: 964838d7-ad13-4f5c-8503-dad6ebc26cf6, rack_id: 0cf2e290-a977-4efb-a951-606f600e35e9, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], use_trust_quorum: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } file = sled-agent/src/bootstrap/server.rs:436
602023-09-20T03:48:30.051ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:448
612023-09-20T03:48:30.051ZINFOSledAgent (StorageManager): KeyManger ready file = sled-agent/src/storage_manager.rs:1407
622023-09-20T03:48:30.051ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:46
632023-09-20T03:48:30.051ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
642023-09-20T03:48:30.093ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:267 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
652023-09-20T03:48:30.093ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:272 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
662023-09-20T03:48:30.113ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/swap", size_gb=64 file = sled-agent/src/swap_device.rs:156
672023-09-20T03:48:30.143ZINFOSledAgent: successfully created encrypted zvol: name="oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/swap", size_gb=64 file = sled-agent/src/swap_device.rs:252
682023-09-20T03:48:30.143ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b/swap" file = sled-agent/src/swap_device.rs:99
692023-09-20T03:48:30.149ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:160
702023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Storage manager processing zpool: ZpoolInfo { name: "oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b", size: 20937965568, allocated: 446976, free: 20937518592, health: Online, } file = sled-agent/src/storage_manager.rs:988
712023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Queuing synthetic disk for upsert: ZpoolName { id: d462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: External } file = sled-agent/src/storage_manager.rs:761
722023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Queuing synthetic disk for upsert: ZpoolName { id: e4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } file = sled-agent/src/storage_manager.rs:761
732023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Queuing synthetic disk for upsert: ZpoolName { id: f4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } file = sled-agent/src/storage_manager.rs:761
742023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Queuing synthetic disk for upsert: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } file = sled-agent/src/storage_manager.rs:761
752023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Queuing synthetic disk for upsert: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } file = sled-agent/src/storage_manager.rs:761
762023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Queuing synthetic disk for upsert: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External } file = sled-agent/src/storage_manager.rs:761
772023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Queuing synthetic disk for upsert: ZpoolName { id: ceb4461c-cf56-4719-ad3c-14430bfdfb60, kind: External } file = sled-agent/src/storage_manager.rs:761
782023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Queuing synthetic disk for upsert: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External } file = sled-agent/src/storage_manager.rs:761
792023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Queuing synthetic disk for upsert: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External } file = sled-agent/src/storage_manager.rs:761
802023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Ensure exact disks: clearing non-synthetic queued disks. file = sled-agent/src/storage_manager.rs:518
812023-09-20T03:48:30.226ZINFOSledAgent (StorageManager): Upserting synthetic disk for: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External } file = sled-agent/src/storage_manager.rs:770
822023-09-20T03:48:30.266ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/fake_vendor-fake_serial-31bd71cd-4736-4a12-a387-9b74b050396f-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:694
832023-09-20T03:48:30.267ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-hardware/src/disk.rs:514
842023-09-20T03:48:30.298ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/fake_vendor-fake_serial-31bd71cd-4736-4a12-a387-9b74b050396f-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:707
852023-09-20T03:48:30.306ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crypt/zone file = sled-hardware/src/disk.rs:560
862023-09-20T03:48:30.436ZINFOSledAgent (StorageManager): Storage manager processing zpool: ZpoolInfo { name: "oxp_31bd71cd-4736-4a12-a387-9b74b050396f", size: 20937965568, allocated: 826368, free: 20937139200, health: Online, } file = sled-agent/src/storage_manager.rs:988
872023-09-20T03:48:30.436ZINFOSledAgent (StorageManager): Upserting synthetic disk for: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External } file = sled-agent/src/storage_manager.rs:770
882023-09-20T03:48:30.478ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/fake_vendor-fake_serial-616b26df-e62a-4c68-b506-f4a923d8aaf7-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:694
892023-09-20T03:48:30.478ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-hardware/src/disk.rs:514
902023-09-20T03:48:30.513ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/fake_vendor-fake_serial-616b26df-e62a-4c68-b506-f4a923d8aaf7-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:707
912023-09-20T03:48:30.521ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/zone file = sled-hardware/src/disk.rs:560
922023-09-20T03:48:30.666ZINFOSledAgent (StorageManager): Storage manager processing zpool: ZpoolInfo { name: "oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7", size: 20937965568, allocated: 772608, free: 20937192960, health: Online, } file = sled-agent/src/storage_manager.rs:988
932023-09-20T03:48:30.666ZINFOSledAgent (StorageManager): Upserting synthetic disk for: ZpoolName { id: d462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: External } file = sled-agent/src/storage_manager.rs:770
942023-09-20T03:48:30.690ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:80 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
952023-09-20T03:48:30.691ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
962023-09-20T03:48:30.708ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/fake_vendor-fake_serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:694
972023-09-20T03:48:30.708ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-hardware/src/disk.rs:514
982023-09-20T03:48:30.741ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/fake_vendor-fake_serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:707
992023-09-20T03:48:30.749ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/zone file = sled-hardware/src/disk.rs:560
1002023-09-20T03:48:30.880ZINFOSledAgent (StorageManager): Storage manager processing zpool: ZpoolInfo { name: "oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b", size: 20937965568, allocated: 783360, free: 20937182208, health: Online, } file = sled-agent/src/storage_manager.rs:988
1012023-09-20T03:48:30.880ZINFOSledAgent (StorageManager): Upserting synthetic disk for: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External } file = sled-agent/src/storage_manager.rs:770
1022023-09-20T03:48:30.920ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/fake_vendor-fake_serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:694
1032023-09-20T03:48:30.920ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-hardware/src/disk.rs:514
1042023-09-20T03:48:30.954ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/fake_vendor-fake_serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:707
1052023-09-20T03:48:30.962ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone file = sled-hardware/src/disk.rs:560
1062023-09-20T03:48:31.116ZINFOSledAgent (StorageManager): Storage manager processing zpool: ZpoolInfo { name: "oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930", size: 20937965568, allocated: 778752, free: 20937186816, health: Online, } file = sled-agent/src/storage_manager.rs:988
1072023-09-20T03:48:31.116ZINFOSledAgent (StorageManager): Upserting synthetic disk for: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } file = sled-agent/src/storage_manager.rs:770
1082023-09-20T03:48:31.164ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/fake_vendor-fake_serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:694
1092023-09-20T03:48:31.164ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-hardware/src/disk.rs:514
1102023-09-20T03:48:31.201ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/fake_vendor-fake_serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:707
1112023-09-20T03:48:31.209ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone file = sled-hardware/src/disk.rs:560
1122023-09-20T03:48:31.342ZINFOSledAgent (StorageManager): Storage manager processing zpool: ZpoolInfo { name: "oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03", size: 20937965568, allocated: 832512, free: 20937133056, health: Online, } file = sled-agent/src/storage_manager.rs:988
1132023-09-20T03:48:31.342ZINFOSledAgent (StorageManager): Upserting synthetic disk for: ZpoolName { id: ceb4461c-cf56-4719-ad3c-14430bfdfb60, kind: External } file = sled-agent/src/storage_manager.rs:770
1142023-09-20T03:48:31.385ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/fake_vendor-fake_serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:694
1152023-09-20T03:48:31.385ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-hardware/src/disk.rs:514
1162023-09-20T03:48:31.415ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/fake_vendor-fake_serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:707
1172023-09-20T03:48:31.422ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone file = sled-hardware/src/disk.rs:560
1182023-09-20T03:48:31.547ZINFOSledAgent (StorageManager): Storage manager processing zpool: ZpoolInfo { name: "oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60", size: 20937965568, allocated: 775680, free: 20937189888, health: Online, } file = sled-agent/src/storage_manager.rs:988
1192023-09-20T03:48:31.547ZINFOSledAgent (StorageManager): Upserting synthetic disk for: ZpoolName { id: e4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } file = sled-agent/src/storage_manager.rs:770
1202023-09-20T03:48:31.588ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/fake_vendor-fake_serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:694
1212023-09-20T03:48:31.588ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-hardware/src/disk.rs:514
1222023-09-20T03:48:31.620ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/fake_vendor-fake_serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:707
1232023-09-20T03:48:31.628ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone file = sled-hardware/src/disk.rs:560
1242023-09-20T03:48:31.757ZINFOSledAgent (StorageManager): Storage manager processing zpool: ZpoolInfo { name: "oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03", size: 20937965568, allocated: 792576, free: 20937172992, health: Online, } file = sled-agent/src/storage_manager.rs:988
1252023-09-20T03:48:31.757ZINFOSledAgent (StorageManager): Upserting synthetic disk for: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } file = sled-agent/src/storage_manager.rs:770
1262023-09-20T03:48:31.797ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/fake_vendor-fake_serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:694
1272023-09-20T03:48:31.797ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-hardware/src/disk.rs:514
1282023-09-20T03:48:31.830ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/fake_vendor-fake_serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:707
1292023-09-20T03:48:31.839ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone file = sled-hardware/src/disk.rs:560
1302023-09-20T03:48:31.964ZINFOSledAgent (StorageManager): Storage manager processing zpool: ZpoolInfo { name: "oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03", size: 20937965568, allocated: 777216, free: 20937188352, health: Online, } file = sled-agent/src/storage_manager.rs:988
1312023-09-20T03:48:31.964ZINFOSledAgent (StorageManager): Upserting synthetic disk for: ZpoolName { id: f4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External } file = sled-agent/src/storage_manager.rs:770
1322023-09-20T03:48:32.004ZINFOSledAgent (StorageManager): Created keyfile /var/run/oxide/fake_vendor-fake_serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:694
1332023-09-20T03:48:32.004ZINFOSledAgent (StorageManager): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-hardware/src/disk.rs:514
1342023-09-20T03:48:32.040ZINFOSledAgent (StorageManager): Zeroed and unlinked keyfile /var/run/oxide/fake_vendor-fake_serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03-zfs-aes-256-gcm.key file = sled-hardware/src/disk.rs:707
1352023-09-20T03:48:32.049ZINFOSledAgent (StorageManager): Automatically destroying dataset: oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/zone file = sled-hardware/src/disk.rs:560
1362023-09-20T03:48:32.173ZINFOSledAgent (StorageManager): Storage manager processing zpool: ZpoolInfo { name: "oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03", size: 20937965568, allocated: 768000, free: 20937197568, health: Online, } file = sled-agent/src/storage_manager.rs:988
1372023-09-20T03:48:32.173ZINFOSledAgent (StorageManager): upserted all queued disks file = sled-agent/src/storage_manager.rs:1168
1382023-09-20T03:48:32.174ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:607
1392023-09-20T03:48:32.177ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "fdfb434afafc46a0bcfaaebdbcc5d8ec", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:533
1402023-09-20T03:48:32.177ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:653
1412023-09-20T03:48:32.177ZINFOSledAgent (InstanceManager): Setting reservoir size to 49090 MiB bytes (50% of 102952026112 total = 51476013056 bytes requested) file = sled-agent/src/instance_manager.rs:130
1422023-09-20T03:48:32.185ZINFOSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:955
1432023-09-20T03:48:32.186ZINFOSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:955
1442023-09-20T03:48:32.186ZINFOSledAgent (StorageManager): failed to notify nexus about a new pool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:492
1452023-09-20T03:48:32.186ZINFOSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:955
1462023-09-20T03:48:32.186ZINFOSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:955
1472023-09-20T03:48:32.187ZINFOSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, variant: M2 } file = sled-agent/src/storage_manager.rs:955
1482023-09-20T03:48:32.187ZINFOSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:955
1492023-09-20T03:48:32.187ZINFOSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, variant: M2 } file = sled-agent/src/storage_manager.rs:955
1502023-09-20T03:48:32.187ZINFOSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:955
1512023-09-20T03:48:32.187ZINFOSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:955
1522023-09-20T03:48:32.187ZINFOSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:955
1532023-09-20T03:48:32.187ZINFOSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:955
1542023-09-20T03:48:32.187ZINFOSledAgent (StorageManager): failed to notify nexus about a new pool oxi_a462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-a462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:492
1552023-09-20T03:48:32.187ZINFOSledAgent (StorageManager): failed to notify nexus about a new pool oxp_31bd71cd-4736-4a12-a387-9b74b050396f on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:492
1562023-09-20T03:48:32.188ZINFOSledAgent (StorageManager): failed to notify nexus about a new pool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:492
1572023-09-20T03:48:32.188ZINFOSledAgent (StorageManager): failed to notify nexus about a new pool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:492
1582023-09-20T03:48:32.188ZINFOSledAgent (StorageManager): failed to notify nexus about a new pool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:492
1592023-09-20T03:48:32.188ZINFOSledAgent (StorageManager): failed to notify nexus about a new pool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:492
1602023-09-20T03:48:32.188ZINFOSledAgent (StorageManager): failed to notify nexus about a new pool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:492
1612023-09-20T03:48:32.188ZINFOSledAgent (StorageManager): failed to notify nexus about a new pool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:492
1622023-09-20T03:48:32.188ZINFOSledAgent (StorageManager): failed to notify nexus about a new pool oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-cd70d7f6-2354-4bf2-8012-55bf9eaf7930", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:492
1632023-09-20T03:48:32.188ZINFOSledAgent (StorageManager): failed to notify nexus about a new pool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:492
1642023-09-20T03:48:32.859ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_switch
1652023-09-20T03:48:35.051ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {}
1662023-09-20T03:48:39.575ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:1312
1672023-09-20T03:48:42.236ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:622 underlay_address = fd00:1122:3344:101::1
1682023-09-20T03:48:42.236ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1692023-09-20T03:48:42.237ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {}
1702023-09-20T03:48:42.237ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:195 local_addr = [fd00:1122:3344:101::1]:12345
1712023-09-20T03:48:42.237ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1722023-09-20T03:48:42.237ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:480
1732023-09-20T03:48:42.237ZINFOSledAgent (SledAgentMain): Checking current full hardware snapshot file = sled-agent/src/bootstrap/pre_server.rs:119 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfig { infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, uplinks: [UplinkConfig { gateway_ip: 10.151.1.100, switch: Switch0, uplink_port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, uplink_cidr: Ipv4Network { addr: 10.151.1.174, prefix: 32 }, uplink_vid: None }] })))
1742023-09-20T03:48:42.237ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:2439
1752023-09-20T03:48:42.246ZINFOSledAgent: failed to notify nexus about sled agent error = Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/964838d7-ad13-4f5c-8503-dad6ebc26cf6): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/sled_agent.rs:563 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1762023-09-20T03:48:42.381ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1772023-09-20T03:48:42.477ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1782023-09-20T03:48:42.561ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1792023-09-20T03:48:42.779ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1802023-09-20T03:48:42.891ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1812023-09-20T03:48:43.160ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1822023-09-20T03:48:43.568ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1832023-09-20T03:48:43.794ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1842023-09-20T03:48:44.107ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1852023-09-20T03:48:44.178ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:9fb2::2 exists in switch zone file = sled-agent/src/services.rs:1329
1862023-09-20T03:48:44.178ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:619 zone = oxz_switch
1872023-09-20T03:48:44.476ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1882023-09-20T03:48:45.258ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1892023-09-20T03:48:45.944ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1902023-09-20T03:48:46.689ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1912023-09-20T03:48:47.238ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {}
1922023-09-20T03:48:47.962ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1932023-09-20T03:48:48.707ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fe24:ca6f file = sled-agent/src/services.rs:1336
1942023-09-20T03:48:48.714ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:1392
1952023-09-20T03:48:48.751ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
1962023-09-20T03:48:48.832ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:1714
1972023-09-20T03:48:49.075ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:1628
1982023-09-20T03:48:49.346ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:1654
1992023-09-20T03:48:49.521ZINFOSledAgent (ServiceManager): Setting up Maghemite service file = sled-agent/src/services.rs:1925
2002023-09-20T03:48:49.698ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:1817
2012023-09-20T03:48:49.761ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
2022023-09-20T03:48:49.852ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:1651
2032023-09-20T03:48:49.862ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:2678 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2042023-09-20T03:48:49.862ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:2695
2052023-09-20T03:48:49.862ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:602 zone = oxz_switch
2062023-09-20T03:48:50.409ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:2703
2072023-09-20T03:48:50.415ZINFOSledAgent (ServiceManager): configuring dendrite zone file = sled-agent/src/services.rs:2744
2082023-09-20T03:48:50.614ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:347
2092023-09-20T03:48:50.648ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 28.0535ms) error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "07065c56-c737-4dfb-923c-0ad153b96fdb", "content-length": "152", "date": "Wed, 20 Sep 2023 03:48:50 GMT"}; value: Error { error_code: Some("DiscoveryNotYetComplete"), message: "discovery process not yet complete", request_id: "07065c56-c737-4dfb-923c-0ad153b96fdb" } file = sled-agent/src/bootstrap/early_networking.rs:366
2102023-09-20T03:48:50.677ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 95.816796ms) error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "aecbec06-e7ce-41e5-879c-5d833cd3c7f4", "content-length": "152", "date": "Wed, 20 Sep 2023 03:48:50 GMT"}; value: Error { error_code: Some("DiscoveryNotYetComplete"), message: "discovery process not yet complete", request_id: "aecbec06-e7ce-41e5-879c-5d833cd3c7f4" } file = sled-agent/src/bootstrap/early_networking.rs:366
2112023-09-20T03:48:50.774ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 205.387198ms) error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "fa5db183-3b5c-4da0-98ea-fe296bbd1015", "content-length": "152", "date": "Wed, 20 Sep 2023 03:48:50 GMT"}; value: Error { error_code: Some("DiscoveryNotYetComplete"), message: "discovery process not yet complete", request_id: "fa5db183-3b5c-4da0-98ea-fe296bbd1015" } file = sled-agent/src/bootstrap/early_networking.rs:366
2122023-09-20T03:48:50.982ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 390.791933ms) error = Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "382ca241-ca52-4b7f-941f-1ed2bf32d3a6", "content-length": "152", "date": "Wed, 20 Sep 2023 03:48:50 GMT"}; value: Error { error_code: Some("DiscoveryNotYetComplete"), message: "discovery process not yet complete", request_id: "382ca241-ca52-4b7f-941f-1ed2bf32d3a6" } file = sled-agent/src/bootstrap/early_networking.rs:366
2132023-09-20T03:48:51.373ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:395
2142023-09-20T03:48:51.406ZINFOSledAgent (ServiceManager): Building Uplink Configuration file = sled-agent/src/bootstrap/early_networking.rs:456
2152023-09-20T03:48:51.406ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:513
2162023-09-20T03:48:51.407ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:516 uptime = 3
2172023-09-20T03:48:51.407ZINFOSledAgent (ServiceManager): Configuring boundary services loopback address on switch config = Ipv6Entry {\n addr: fd00:99::1,\n tag: "rss",\n} file = sled-agent/src/bootstrap/early_networking.rs:417
2182023-09-20T03:48:51.407ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n speed: Speed40G,\n },\n },\n },\n tag: "rss",\n v4_routes: {\n "0.0.0.0/0": RouteSettingsV4 {\n link_id: 0,\n nexthop: Some(\n 10.151.1.100,\n ),\n vid: None,\n },\n },\n v6_routes: {},\n} file = sled-agent/src/bootstrap/early_networking.rs:428
2192023-09-20T03:48:51.408ZINFOSledAgent (ServiceManager): advertising boundary services loopback address file = sled-agent/src/bootstrap/early_networking.rs:441
2202023-09-20T03:48:51.443ZINFOSledAgent (ServiceManager): Sending prefix to ddmd for advertisement DdmAdminClient = [fd00:1122:3344:101::2]:8000 file = ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fd00:99::, len: 64 }
2212023-09-20T03:48:51.489ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:60994
2222023-09-20T03:48:51.489ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2232023-09-20T03:48:51.489ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2242023-09-20T03:48:51.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34404
2252023-09-20T03:48:51.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34404 req_id = fd02149a-8c8a-4ee5-8a46-e53aaaf2ae04 response_code = 200 uri = /zpools
2262023-09-20T03:48:51.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47211
2272023-09-20T03:48:51.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47211 req_id = 4e245fde-4047-493a-8a89-fdedbcb606eb response_code = 200 uri = /sled-role
2282023-09-20T03:48:51.560ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:735
2292023-09-20T03:48:51.591ZINFOSledAgent (RSS): sending service requests... file = sled-agent/src/rack_setup/service.rs:282
2302023-09-20T03:48:51.591ZINFOSledAgent (RSS): initializing sled services: [ServiceZoneRequest { addresses: [fd00:1122:3344:1::1], dataset: Some(DatasetRequest { id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_31bd71cd-4736-4a12-a387-9b74b050396f") }, service_address: "[fd00:1122:3344:1::1]:5353" }), id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:1::1]:53", gz_address: fd00:1122:3344:1::2, gz_address_index: 0, http_address: "[fd00:1122:3344:1::1]:5353" }, id: a5db5e2c-8e54-4f39-9689-3ea4f264af81 }], zone_type: InternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:2::1], dataset: Some(DatasetRequest { id: a29497ec-9b94-42a0-9136-a20c59f4c77e, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:2::1]:5353" }), id: a29497ec-9b94-42a0-9136-a20c59f4c77e, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:2::1]:53", gz_address: fd00:1122:3344:2::2, gz_address_index: 1, http_address: "[fd00:1122:3344:2::1]:5353" }, id: a29497ec-9b94-42a0-9136-a20c59f4c77e }], zone_type: InternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:3::1], dataset: Some(DatasetRequest { id: a296927f-5e12-488a-867b-511d5864f1fe, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7") }, service_address: "[fd00:1122:3344:3::1]:5353" }), id: a296927f-5e12-488a-867b-511d5864f1fe, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:3::1]:53", gz_address: fd00:1122:3344:3::2, gz_address_index: 2, http_address: "[fd00:1122:3344:3::1]:5353" }, id: a296927f-5e12-488a-867b-511d5864f1fe }], zone_type: InternalDns }] file = sled-agent/src/rack_setup/service.rs:284
2312023-09-20T03:48:51.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50981
2322023-09-20T03:48:51.591ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
2332023-09-20T03:48:51.651ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a29497ec-9b94-42a0-9136-a20c59f4c77e, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
2342023-09-20T03:48:51.705ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a296927f-5e12-488a-867b-511d5864f1fe, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
2352023-09-20T03:48:51.712ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
2362023-09-20T03:48:51.825ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a5db5e2c-8e54-4f39-9689-3ea4f264af81 file = illumos-utils/src/zone.rs:314
2372023-09-20T03:48:51.829ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a29497ec-9b94-42a0-9136-a20c59f4c77e file = illumos-utils/src/zone.rs:314
2382023-09-20T03:48:51.833ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a296927f-5e12-488a-867b-511d5864f1fe file = illumos-utils/src/zone.rs:314
2392023-09-20T03:48:51.844ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a5db5e2c-8e54-4f39-9689-3ea4f264af81 file = illumos-utils/src/zone.rs:353
2402023-09-20T03:48:51.849ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a29497ec-9b94-42a0-9136-a20c59f4c77e file = illumos-utils/src/zone.rs:353
2412023-09-20T03:48:51.854ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a296927f-5e12-488a-867b-511d5864f1fe file = illumos-utils/src/zone.rs:353
2422023-09-20T03:48:52.241ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {}
2432023-09-20T03:48:53.160ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
2442023-09-20T03:48:53.549ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_internal_dns_a296927f-5e12-488a-867b-511d5864f1fe
2452023-09-20T03:48:53.568ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_internal_dns_a5db5e2c-8e54-4f39-9689-3ea4f264af81
2462023-09-20T03:48:53.585ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_internal_dns_a29497ec-9b94-42a0-9136-a20c59f4c77e
2472023-09-20T03:48:54.618ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37900
2482023-09-20T03:48:54.619ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 720 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37900 req_id = a1969835-38b7-45bf-8cf2-422e0aa7b3c4 response_code = 200 uri = /baseboard
2492023-09-20T03:48:55.734ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
2502023-09-20T03:48:57.242ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
2512023-09-20T03:48:58.731ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:2::1 exists file = sled-agent/src/services.rs:1358
2522023-09-20T03:48:58.731ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:2::1, prefix: 64 })) file = illumos-utils/src/running_zone.rs:602 zone = oxz_internal_dns_a29497ec-9b94-42a0-9136-a20c59f4c77e
2532023-09-20T03:48:59.297ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:2::1 exists - OK file = sled-agent/src/services.rs:1366
2542023-09-20T03:48:59.297ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:1392
2552023-09-20T03:48:59.467ZINFOSledAgent (ServiceManager): Setting up internal-dns service file = sled-agent/src/services.rs:1560
2562023-09-20T03:48:59.993ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
2572023-09-20T03:48:59.993ZINFOSledAgent: contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6 sled_id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
2582023-09-20T03:49:00.047ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:1::1 exists file = sled-agent/src/services.rs:1358
2592023-09-20T03:49:00.047ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:1::1, prefix: 64 })) file = illumos-utils/src/running_zone.rs:602 zone = oxz_internal_dns_a5db5e2c-8e54-4f39-9689-3ea4f264af81
2602023-09-20T03:49:00.604ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:1::1 exists - OK file = sled-agent/src/services.rs:1366
2612023-09-20T03:49:00.604ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:1392
2622023-09-20T03:49:00.774ZINFOSledAgent (ServiceManager): Setting up internal-dns service file = sled-agent/src/services.rs:1560
2632023-09-20T03:49:01.327ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:3::1 exists file = sled-agent/src/services.rs:1358
2642023-09-20T03:49:01.327ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:3::1, prefix: 64 })) file = illumos-utils/src/running_zone.rs:602 zone = oxz_internal_dns_a296927f-5e12-488a-867b-511d5864f1fe
2652023-09-20T03:49:01.876ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:3::1 exists - OK file = sled-agent/src/services.rs:1366
2662023-09-20T03:49:01.876ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:1392
2672023-09-20T03:49:02.047ZINFOSledAgent (ServiceManager): Setting up internal-dns service file = sled-agent/src/services.rs:1560
2682023-09-20T03:49:02.243ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
2692023-09-20T03:49:02.527ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
2702023-09-20T03:49:02.583ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:91 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
2712023-09-20T03:49:02.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 10992701 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50981 req_id = 028d4a68-53c4-4364-8ae9-c8783c0bca4f response_code = 204 uri = /services
2722023-09-20T03:49:02.586ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:391
2732023-09-20T03:49:02.604ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-d462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 30.426337503s
2742023-09-20T03:49:02.604ZWARNSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:957 total duration = 30.428122327s
2752023-09-20T03:49:02.604ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 30.427317161s
2762023-09-20T03:49:02.604ZWARNSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" }, variant: M2 } file = sled-agent/src/storage_manager.rs:957 total duration = 30.428637346s
2772023-09-20T03:49:02.625ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:391
2782023-09-20T03:49:02.666ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:391
2792023-09-20T03:49:03.261ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:427
2802023-09-20T03:49:03.261ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:241
2812023-09-20T03:49:03.294ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:258
2822023-09-20T03:49:03.294ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:283
2832023-09-20T03:49:03.294ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:175
2842023-09-20T03:49:03.325ZINFOSledAgent (RSS): sending service requests... file = sled-agent/src/rack_setup/service.rs:282
2852023-09-20T03:49:03.325ZINFOSledAgent (RSS): initializing sled services: [ServiceZoneRequest { addresses: [fd00:1122:3344:1::1], dataset: Some(DatasetRequest { id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_31bd71cd-4736-4a12-a387-9b74b050396f") }, service_address: "[fd00:1122:3344:1::1]:5353" }), id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:1::1]:53", gz_address: fd00:1122:3344:1::2, gz_address_index: 0, http_address: "[fd00:1122:3344:1::1]:5353" }, id: a5db5e2c-8e54-4f39-9689-3ea4f264af81 }], zone_type: InternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:2::1], dataset: Some(DatasetRequest { id: a29497ec-9b94-42a0-9136-a20c59f4c77e, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:2::1]:5353" }), id: a29497ec-9b94-42a0-9136-a20c59f4c77e, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:2::1]:53", gz_address: fd00:1122:3344:2::2, gz_address_index: 1, http_address: "[fd00:1122:3344:2::1]:5353" }, id: a29497ec-9b94-42a0-9136-a20c59f4c77e }], zone_type: InternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:3::1], dataset: Some(DatasetRequest { id: a296927f-5e12-488a-867b-511d5864f1fe, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7") }, service_address: "[fd00:1122:3344:3::1]:5353" }), id: a296927f-5e12-488a-867b-511d5864f1fe, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:3::1]:53", gz_address: fd00:1122:3344:3::2, gz_address_index: 2, http_address: "[fd00:1122:3344:3::1]:5353" }, id: a296927f-5e12-488a-867b-511d5864f1fe }], zone_type: InternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::1b], dataset: None, id: 53a0e933-3473-4a9f-b17a-039ac7ee8915, services: [ServiceZoneService { details: BoundaryNtp { address: "[fd00:1122:3344:101::1b]:123", dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0a6f5d02-3be4-4692-be87-916d30e598ad, ip: 172.30.3.5, kind: Service(53a0e933-3473-4a9f-b17a-039ac7ee8915), mac: MacAddr("A8:40:25:FF:B8:73"), name: Name("ntp-53a0e933-3473-4a9f-b17a-039ac7ee8915"), primary: true, slot: 0, subnet: V4(Ipv4Net("172.30.3.0/24")), vni: Vni(100) }, ntp_servers: ["0.pool.ntp.org"], snat_cfg: SourceNatConfig { first_port: 0, ip: 10.151.1.169, last_port: 16383 } }, id: 53a0e933-3473-4a9f-b17a-039ac7ee8915 }], zone_type: Ntp }] file = sled-agent/src/rack_setup/service.rs:284
2862023-09-20T03:49:03.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49037
2872023-09-20T03:49:03.325ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
2882023-09-20T03:49:03.344ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a29497ec-9b94-42a0-9136-a20c59f4c77e, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
2892023-09-20T03:49:03.363ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a296927f-5e12-488a-867b-511d5864f1fe, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
2902023-09-20T03:49:03.382ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:241
2912023-09-20T03:49:03.417ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:258
2922023-09-20T03:49:03.418ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:283
2932023-09-20T03:49:03.418ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:175
2942023-09-20T03:49:03.466ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:376 port = Port { inner: PortInner { name: "opte0", _ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 184, 115]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
2952023-09-20T03:49:03.466ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:881 service = ServiceZoneService { id: 53a0e933-3473-4a9f-b17a-039ac7ee8915, details: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0a6f5d02-3be4-4692-be87-916d30e598ad, kind: Service { id: 53a0e933-3473-4a9f-b17a-039ac7ee8915 }, name: Name("ntp-53a0e933-3473-4a9f-b17a-039ac7ee8915"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 115])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }
2962023-09-20T03:49:03.467ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.169, prefix: 32, }, ) file = dpd-client/src/lib.rs:98
2972023-09-20T03:49:03.467ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.169, prefix: 32, }, ) file = dpd-client/src/lib.rs:105
2982023-09-20T03:49:03.467ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.169, prefix: 32, }, ) file = dpd-client/src/lib.rs:133
2992023-09-20T03:49:03.494ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915 file = illumos-utils/src/zone.rs:314
3002023-09-20T03:49:03.514ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915 file = illumos-utils/src/zone.rs:353
3012023-09-20T03:49:04.477ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915
3022023-09-20T03:49:05.946ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 33.768490556s
3032023-09-20T03:49:06.106ZWARNSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:957 total duration = 33.932896785s
3042023-09-20T03:49:06.106ZWARNSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:957 total duration = 33.930328167s
3052023-09-20T03:49:07.245ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
3062023-09-20T03:49:07.251ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-ceb4461c-cf56-4719-ad3c-14430bfdfb60", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 35.073852006s
3072023-09-20T03:49:10.176ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::1b exists file = sled-agent/src/services.rs:1358
3082023-09-20T03:49:10.177ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::1b, prefix: 64 })) file = illumos-utils/src/running_zone.rs:602 zone = oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915
3092023-09-20T03:49:10.728ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::1b exists - OK file = sled-agent/src/services.rs:1366
3102023-09-20T03:49:10.728ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1387
3112023-09-20T03:49:10.925ZINFOSledAgent (ServiceManager): Set up NTP service boundary=true, Servers=["0.pool.ntp.org"] file = sled-agent/src/services.rs:1875
3122023-09-20T03:49:10.953ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:646 zone = oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915
3132023-09-20T03:49:15.811ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
3142023-09-20T03:49:15.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 12534710 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49037 req_id = 9aede166-e987-4f48-be9e-7b3118740ac0 response_code = 204 uri = /services
3152023-09-20T03:49:15.862ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:466
3162023-09-20T03:49:15.893ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3172023-09-20T03:49:15.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42951
3182023-09-20T03:49:15.902ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:2425
3192023-09-20T03:49:15.902ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:841 latency_us = 9061 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42951 req_id = c07ed8fc-d349-473f-ab3a-7436fd741324 response_code = 500 uri = /timesync
3202023-09-20T03:49:15.905ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3212023-09-20T03:49:16.077ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3222023-09-20T03:49:16.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39313
3232023-09-20T03:49:16.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 8164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39313 req_id = b6946c3e-c002-4cff-98dc-03d1da188f49 response_code = 200 uri = /timesync
3242023-09-20T03:49:16.088ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3252023-09-20T03:49:16.088ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3262023-09-20T03:49:16.297ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3272023-09-20T03:49:16.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51115
3282023-09-20T03:49:16.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 8502 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51115 req_id = 682f3d9c-6b41-4f53-8477-df9efd899dad response_code = 200 uri = /timesync
3292023-09-20T03:49:16.309ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3302023-09-20T03:49:16.309ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3312023-09-20T03:49:16.478ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3322023-09-20T03:49:16.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51699
3332023-09-20T03:49:16.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 8013 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51699 req_id = bf609780-f9e6-47a2-b22b-6cca4658f8e4 response_code = 200 uri = /timesync
3342023-09-20T03:49:16.488ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3352023-09-20T03:49:16.488ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3362023-09-20T03:49:16.720ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3372023-09-20T03:49:16.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42176
3382023-09-20T03:49:16.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 8111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42176 req_id = 99797ae8-29f8-43a6-a070-e1bc5bb7a0d4 response_code = 200 uri = /timesync
3392023-09-20T03:49:16.731ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3402023-09-20T03:49:16.731ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3412023-09-20T03:49:17.004ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3422023-09-20T03:49:17.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56299
3432023-09-20T03:49:17.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 8306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56299 req_id = 147cf1d3-10a2-444d-92ff-a5d7e329c8ee response_code = 200 uri = /timesync
3442023-09-20T03:49:17.015ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3452023-09-20T03:49:17.015ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3462023-09-20T03:49:17.390ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3472023-09-20T03:49:17.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46692
3482023-09-20T03:49:17.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 8844 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46692 req_id = 2effcbc5-0106-407b-b424-76b3b643c59f response_code = 200 uri = /timesync
3492023-09-20T03:49:17.402ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3502023-09-20T03:49:17.402ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3512023-09-20T03:49:17.829ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3522023-09-20T03:49:17.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45248
3532023-09-20T03:49:17.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 8486 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45248 req_id = f9570fc4-39e0-4f7d-a3e5-bd67272af97c response_code = 200 uri = /timesync
3542023-09-20T03:49:17.840ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3552023-09-20T03:49:17.840ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3562023-09-20T03:49:18.276ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3572023-09-20T03:49:18.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40873
3582023-09-20T03:49:18.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 9281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40873 req_id = ecf8cc14-cb6a-4cc0-9170-ec7c0e99ee25 response_code = 200 uri = /timesync
3592023-09-20T03:49:18.288ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3602023-09-20T03:49:18.288ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3612023-09-20T03:49:18.851ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3622023-09-20T03:49:18.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43112
3632023-09-20T03:49:18.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 8677 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43112 req_id = e43624e8-f70d-4da3-98de-189caea69f0a response_code = 200 uri = /timesync
3642023-09-20T03:49:18.864ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3652023-09-20T03:49:18.864ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3662023-09-20T03:49:19.650ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3672023-09-20T03:49:19.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61739
3682023-09-20T03:49:19.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 8642 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61739 req_id = abf2e3a3-d6c1-4765-aed0-f9c0e50ca4c7 response_code = 200 uri = /timesync
3692023-09-20T03:49:19.661ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3702023-09-20T03:49:19.661ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3712023-09-20T03:49:20.014ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3722023-09-20T03:49:20.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42814
3732023-09-20T03:49:20.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 8560 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42814 req_id = 2183bbb1-4091-4b6a-a12c-3942e10f74cf response_code = 200 uri = /timesync
3742023-09-20T03:49:20.025ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3752023-09-20T03:49:20.025ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:496
3762023-09-20T03:49:20.100ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
3772023-09-20T03:49:20.185ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:448
3782023-09-20T03:49:20.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62756
3792023-09-20T03:49:20.189ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/storage/dump_setup.rs:530
3802023-09-20T03:49:20.195ZINFOSledAgent (ServiceManager): Setting boot time to 1695181760.195029634s file = sled-agent/src/services.rs:2340
3812023-09-20T03:49:20.201ZWARNSledAgent (ServiceManager): Updating /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a29497ec-9b94-42a0-9136-a20c59f4c77e/root/var/adm/utmpx failed: Command [/usr/platform/oxide/bin/tmpx 1695181760 /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a29497ec-9b94-42a0-9136-a20c59f4c77e/root/var/adm/utmpx] executed and failed with status: exit status: 1 stdout: stderr: tmpx: Invalid path: '/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a29497ec-9b94-42a0-9136-a20c59f4c77e/root/var/adm/utmpx' (see utmpxname(3C)) file = sled-agent/src/services.rs:2357
3822023-09-20T03:49:20.206ZWARNSledAgent (ServiceManager): Updating /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a29497ec-9b94-42a0-9136-a20c59f4c77e/root/var/adm/wtmpx failed: Command [/usr/platform/oxide/bin/tmpx 1695181760 /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a29497ec-9b94-42a0-9136-a20c59f4c77e/root/var/adm/wtmpx] executed and failed with status: exit status: 1 stdout: stderr: tmpx: Invalid path: '/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a29497ec-9b94-42a0-9136-a20c59f4c77e/root/var/adm/wtmpx' (see utmpxname(3C)) file = sled-agent/src/services.rs:2357
3832023-09-20T03:49:20.212ZWARNSledAgent (ServiceManager): Updating /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_internal_dns_a296927f-5e12-488a-867b-511d5864f1fe/root/var/adm/utmpx failed: Command [/usr/platform/oxide/bin/tmpx 1695181760 /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_internal_dns_a296927f-5e12-488a-867b-511d5864f1fe/root/var/adm/utmpx] executed and failed with status: exit status: 1 stdout: stderr: tmpx: Invalid path: '/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_internal_dns_a296927f-5e12-488a-867b-511d5864f1fe/root/var/adm/utmpx' (see utmpxname(3C)) file = sled-agent/src/services.rs:2357
3842023-09-20T03:49:20.217ZWARNSledAgent (ServiceManager): Updating /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_internal_dns_a296927f-5e12-488a-867b-511d5864f1fe/root/var/adm/wtmpx failed: Command [/usr/platform/oxide/bin/tmpx 1695181760 /pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_internal_dns_a296927f-5e12-488a-867b-511d5864f1fe/root/var/adm/wtmpx] executed and failed with status: exit status: 1 stdout: stderr: tmpx: Invalid path: '/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/zone/oxz_internal_dns_a296927f-5e12-488a-867b-511d5864f1fe/root/var/adm/wtmpx' (see utmpxname(3C)) file = sled-agent/src/services.rs:2357
3852023-09-20T03:49:20.223ZWARNSledAgent (ServiceManager): Updating /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a5db5e2c-8e54-4f39-9689-3ea4f264af81/root/var/adm/utmpx failed: Command [/usr/platform/oxide/bin/tmpx 1695181760 /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a5db5e2c-8e54-4f39-9689-3ea4f264af81/root/var/adm/utmpx] executed and failed with status: exit status: 1 stdout: stderr: tmpx: Invalid path: '/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a5db5e2c-8e54-4f39-9689-3ea4f264af81/root/var/adm/utmpx' (see utmpxname(3C)) file = sled-agent/src/services.rs:2357
3862023-09-20T03:49:20.228ZWARNSledAgent (ServiceManager): Updating /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a5db5e2c-8e54-4f39-9689-3ea4f264af81/root/var/adm/wtmpx failed: Command [/usr/platform/oxide/bin/tmpx 1695181760 /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a5db5e2c-8e54-4f39-9689-3ea4f264af81/root/var/adm/wtmpx] executed and failed with status: exit status: 1 stdout: stderr: tmpx: Invalid path: '/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_internal_dns_a5db5e2c-8e54-4f39-9689-3ea4f264af81/root/var/adm/wtmpx' (see utmpxname(3C)) file = sled-agent/src/services.rs:2357
3872023-09-20T03:49:20.234ZWARNSledAgent (ServiceManager): Updating /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915/root/var/adm/utmpx failed: Command [/usr/platform/oxide/bin/tmpx 1695181760 /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915/root/var/adm/utmpx] executed and failed with status: exit status: 1 stdout: stderr: tmpx: Invalid path: '/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915/root/var/adm/utmpx' (see utmpxname(3C)) file = sled-agent/src/services.rs:2357
3882023-09-20T03:49:20.240ZWARNSledAgent (ServiceManager): Updating /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915/root/var/adm/wtmpx failed: Command [/usr/platform/oxide/bin/tmpx 1695181760 /pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915/root/var/adm/wtmpx] executed and failed with status: exit status: 1 stdout: stderr: tmpx: Invalid path: '/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/zone/oxz_ntp_53a0e933-3473-4a9f-b17a-039ac7ee8915/root/var/adm/wtmpx' (see utmpxname(3C)) file = sled-agent/src/services.rs:2357
3892023-09-20T03:49:20.246ZINFOSledAgent (ServiceManager): Updated /var/adm/utmpx file = sled-agent/src/services.rs:2360
3902023-09-20T03:49:20.251ZINFOSledAgent (ServiceManager): Updated /var/adm/wtmpx file = sled-agent/src/services.rs:2360
3912023-09-20T03:49:20.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 66568 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62756 req_id = 331199fa-0a7c-4790-99c1-7f0b9cab37dd response_code = 200 uri = /timesync
3922023-09-20T03:49:20.254ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 394502151, ip_addr: 23.131.160.7, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:474
3932023-09-20T03:49:20.254ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:937
3942023-09-20T03:49:20.286ZINFOSledAgent (RSS): sending service requests... file = sled-agent/src/rack_setup/service.rs:282
3952023-09-20T03:49:20.286ZINFOSledAgent (RSS): initializing sled services: [ServiceZoneRequest { addresses: [fd00:1122:3344:1::1], dataset: Some(DatasetRequest { id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_31bd71cd-4736-4a12-a387-9b74b050396f") }, service_address: "[fd00:1122:3344:1::1]:5353" }), id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:1::1]:53", gz_address: fd00:1122:3344:1::2, gz_address_index: 0, http_address: "[fd00:1122:3344:1::1]:5353" }, id: a5db5e2c-8e54-4f39-9689-3ea4f264af81 }], zone_type: InternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:2::1], dataset: Some(DatasetRequest { id: a29497ec-9b94-42a0-9136-a20c59f4c77e, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:2::1]:5353" }), id: a29497ec-9b94-42a0-9136-a20c59f4c77e, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:2::1]:53", gz_address: fd00:1122:3344:2::2, gz_address_index: 1, http_address: "[fd00:1122:3344:2::1]:5353" }, id: a29497ec-9b94-42a0-9136-a20c59f4c77e }], zone_type: InternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:3::1], dataset: Some(DatasetRequest { id: a296927f-5e12-488a-867b-511d5864f1fe, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7") }, service_address: "[fd00:1122:3344:3::1]:5353" }), id: a296927f-5e12-488a-867b-511d5864f1fe, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:3::1]:53", gz_address: fd00:1122:3344:3::2, gz_address_index: 2, http_address: "[fd00:1122:3344:3::1]:5353" }, id: a296927f-5e12-488a-867b-511d5864f1fe }], zone_type: InternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::3], dataset: Some(DatasetRequest { id: e2efcbab-f26d-427a-9878-d9bbcbd54b26, name: DatasetName { kind: CockroachDb, pool_name: ZpoolName("oxp_31bd71cd-4736-4a12-a387-9b74b050396f") }, service_address: "[fd00:1122:3344:101::3]:32221" }), id: e2efcbab-f26d-427a-9878-d9bbcbd54b26, services: [ServiceZoneService { details: CockroachDb { address: "[fd00:1122:3344:101::3]:32221" }, id: e2efcbab-f26d-427a-9878-d9bbcbd54b26 }], zone_type: CockroachDb }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::4], dataset: Some(DatasetRequest { id: 237e1ccf-9c97-48c5-bdd2-06af0c9412de, name: DatasetName { kind: CockroachDb, pool_name: ZpoolName("oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:101::4]:32221" }), id: 237e1ccf-9c97-48c5-bdd2-06af0c9412de, services: [ServiceZoneService { details: CockroachDb { address: "[fd00:1122:3344:101::4]:32221" }, id: 237e1ccf-9c97-48c5-bdd2-06af0c9412de }], zone_type: CockroachDb }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::5], dataset: Some(DatasetRequest { id: 14a002ac-4996-43b3-92d5-ecae98936197, name: DatasetName { kind: CockroachDb, pool_name: ZpoolName("oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7") }, service_address: "[fd00:1122:3344:101::5]:32221" }), id: 14a002ac-4996-43b3-92d5-ecae98936197, services: [ServiceZoneService { details: CockroachDb { address: "[fd00:1122:3344:101::5]:32221" }, id: 14a002ac-4996-43b3-92d5-ecae98936197 }], zone_type: CockroachDb }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::6], dataset: Some(DatasetRequest { id: f207d0a2-721a-48a5-8439-beab99cf8636, name: DatasetName { kind: CockroachDb, pool_name: ZpoolName("oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60") }, service_address: "[fd00:1122:3344:101::6]:32221" }), id: f207d0a2-721a-48a5-8439-beab99cf8636, services: [ServiceZoneService { details: CockroachDb { address: "[fd00:1122:3344:101::6]:32221" }, id: f207d0a2-721a-48a5-8439-beab99cf8636 }], zone_type: CockroachDb }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::7], dataset: Some(DatasetRequest { id: 6dd2ceaa-bb97-452d-b091-627d2fb3ff54, name: DatasetName { kind: CockroachDb, pool_name: ZpoolName("oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:101::7]:32221" }), id: 6dd2ceaa-bb97-452d-b091-627d2fb3ff54, services: [ServiceZoneService { details: CockroachDb { address: "[fd00:1122:3344:101::7]:32221" }, id: 6dd2ceaa-bb97-452d-b091-627d2fb3ff54 }], zone_type: CockroachDb }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::1b], dataset: None, id: 53a0e933-3473-4a9f-b17a-039ac7ee8915, services: [ServiceZoneService { details: BoundaryNtp { address: "[fd00:1122:3344:101::1b]:123", dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0a6f5d02-3be4-4692-be87-916d30e598ad, ip: 172.30.3.5, kind: Service(53a0e933-3473-4a9f-b17a-039ac7ee8915), mac: MacAddr("A8:40:25:FF:B8:73"), name: Name("ntp-53a0e933-3473-4a9f-b17a-039ac7ee8915"), primary: true, slot: 0, subnet: V4(Ipv4Net("172.30.3.0/24")), vni: Vni(100) }, ntp_servers: ["0.pool.ntp.org"], snat_cfg: SourceNatConfig { first_port: 0, ip: 10.151.1.169, last_port: 16383 } }, id: 53a0e933-3473-4a9f-b17a-039ac7ee8915 }], zone_type: Ntp }] file = sled-agent/src/rack_setup/service.rs:284
3962023-09-20T03:49:20.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48242
3972023-09-20T03:49:20.286ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
3982023-09-20T03:49:20.306ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a29497ec-9b94-42a0-9136-a20c59f4c77e, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
3992023-09-20T03:49:20.327ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a296927f-5e12-488a-867b-511d5864f1fe, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4002023-09-20T03:49:20.345ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: e2efcbab-f26d-427a-9878-d9bbcbd54b26, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4012023-09-20T03:49:20.397ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 237e1ccf-9c97-48c5-bdd2-06af0c9412de, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4022023-09-20T03:49:20.447ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 14a002ac-4996-43b3-92d5-ecae98936197, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4032023-09-20T03:49:20.499ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: f207d0a2-721a-48a5-8439-beab99cf8636, dataset_name: DatasetName { pool_name: ZpoolName { id: ceb4461c-cf56-4719-ad3c-14430bfdfb60, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4042023-09-20T03:49:20.554ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 6dd2ceaa-bb97-452d-b091-627d2fb3ff54, dataset_name: DatasetName { pool_name: ZpoolName { id: e4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4052023-09-20T03:49:20.708ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_14a002ac-4996-43b3-92d5-ecae98936197 file = illumos-utils/src/zone.rs:314
4062023-09-20T03:49:20.713ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f207d0a2-721a-48a5-8439-beab99cf8636 file = illumos-utils/src/zone.rs:314
4072023-09-20T03:49:20.718ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e2efcbab-f26d-427a-9878-d9bbcbd54b26 file = illumos-utils/src/zone.rs:314
4082023-09-20T03:49:20.722ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6dd2ceaa-bb97-452d-b091-627d2fb3ff54 file = illumos-utils/src/zone.rs:314
4092023-09-20T03:49:20.726ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_237e1ccf-9c97-48c5-bdd2-06af0c9412de file = illumos-utils/src/zone.rs:314
4102023-09-20T03:49:20.731ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_14a002ac-4996-43b3-92d5-ecae98936197 file = illumos-utils/src/zone.rs:353
4112023-09-20T03:49:20.736ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f207d0a2-721a-48a5-8439-beab99cf8636 file = illumos-utils/src/zone.rs:353
4122023-09-20T03:49:20.741ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e2efcbab-f26d-427a-9878-d9bbcbd54b26 file = illumos-utils/src/zone.rs:353
4132023-09-20T03:49:20.745ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6dd2ceaa-bb97-452d-b091-627d2fb3ff54 file = illumos-utils/src/zone.rs:353
4142023-09-20T03:49:20.750ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_237e1ccf-9c97-48c5-bdd2-06af0c9412de file = illumos-utils/src/zone.rs:353
4152023-09-20T03:49:24.833ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36245
4162023-09-20T03:49:24.836ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 92 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36245 req_id = 11c1e206-0678-4d8f-a770-7438bfba53f6 response_code = 200 uri = /baseboard
4172023-09-20T03:49:25.554ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e2efcbab-f26d-427a-9878-d9bbcbd54b26: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::3"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4182023-09-20T03:49:25.554ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_cockroachdb_e2efcbab-f26d-427a-9878-d9bbcbd54b26
4192023-09-20T03:49:25.558ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/storage/dump_setup.rs:530
4202023-09-20T03:49:25.947ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
4212023-09-20T03:49:27.558ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_14a002ac-4996-43b3-92d5-ecae98936197: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::5"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4222023-09-20T03:49:27.558ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_cockroachdb_14a002ac-4996-43b3-92d5-ecae98936197
4232023-09-20T03:49:27.581ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6dd2ceaa-bb97-452d-b091-627d2fb3ff54: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::7"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4242023-09-20T03:49:27.582ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_cockroachdb_6dd2ceaa-bb97-452d-b091-627d2fb3ff54
4252023-09-20T03:49:27.648ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_237e1ccf-9c97-48c5-bdd2-06af0c9412de: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::4"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4262023-09-20T03:49:27.649ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_cockroachdb_237e1ccf-9c97-48c5-bdd2-06af0c9412de
4272023-09-20T03:49:27.682ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f207d0a2-721a-48a5-8439-beab99cf8636: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::6"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4282023-09-20T03:49:27.682ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_cockroachdb_f207d0a2-721a-48a5-8439-beab99cf8636
4292023-09-20T03:49:30.935ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
4302023-09-20T03:49:35.923ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
4312023-09-20T03:49:40.912ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
4322023-09-20T03:49:43.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 21926328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48242 req_id = 51b9bbd1-3cf1-40c0-b028-a1bbddf3e9d0 response_code = 204 uri = /services
4332023-09-20T03:49:43.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55419
4342023-09-20T03:49:43.074ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:2271
4352023-09-20T03:49:43.239ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:2289
4362023-09-20T03:49:44.571ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:2310
4372023-09-20T03:49:44.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 1530004 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:55419 req_id = 1aa2d334-5f4c-4da6-bbd9-642daf39ea16 response_code = 204 uri = /cockroachdb
4382023-09-20T03:49:44.607ZINFOSledAgent (RSS): sending service requests... file = sled-agent/src/rack_setup/service.rs:282
4392023-09-20T03:49:44.607ZINFOSledAgent (RSS): initializing sled services: [ServiceZoneRequest { addresses: [fd00:1122:3344:1::1], dataset: Some(DatasetRequest { id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_31bd71cd-4736-4a12-a387-9b74b050396f") }, service_address: "[fd00:1122:3344:1::1]:5353" }), id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:1::1]:53", gz_address: fd00:1122:3344:1::2, gz_address_index: 0, http_address: "[fd00:1122:3344:1::1]:5353" }, id: a5db5e2c-8e54-4f39-9689-3ea4f264af81 }], zone_type: InternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:2::1], dataset: Some(DatasetRequest { id: a29497ec-9b94-42a0-9136-a20c59f4c77e, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:2::1]:5353" }), id: a29497ec-9b94-42a0-9136-a20c59f4c77e, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:2::1]:53", gz_address: fd00:1122:3344:2::2, gz_address_index: 1, http_address: "[fd00:1122:3344:2::1]:5353" }, id: a29497ec-9b94-42a0-9136-a20c59f4c77e }], zone_type: InternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:3::1], dataset: Some(DatasetRequest { id: a296927f-5e12-488a-867b-511d5864f1fe, name: DatasetName { kind: InternalDns, pool_name: ZpoolName("oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7") }, service_address: "[fd00:1122:3344:3::1]:5353" }), id: a296927f-5e12-488a-867b-511d5864f1fe, services: [ServiceZoneService { details: InternalDns { dns_address: "[fd00:1122:3344:3::1]:53", gz_address: fd00:1122:3344:3::2, gz_address_index: 2, http_address: "[fd00:1122:3344:3::1]:5353" }, id: a296927f-5e12-488a-867b-511d5864f1fe }], zone_type: InternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::3], dataset: Some(DatasetRequest { id: e2efcbab-f26d-427a-9878-d9bbcbd54b26, name: DatasetName { kind: CockroachDb, pool_name: ZpoolName("oxp_31bd71cd-4736-4a12-a387-9b74b050396f") }, service_address: "[fd00:1122:3344:101::3]:32221" }), id: e2efcbab-f26d-427a-9878-d9bbcbd54b26, services: [ServiceZoneService { details: CockroachDb { address: "[fd00:1122:3344:101::3]:32221" }, id: e2efcbab-f26d-427a-9878-d9bbcbd54b26 }], zone_type: CockroachDb }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::4], dataset: Some(DatasetRequest { id: 237e1ccf-9c97-48c5-bdd2-06af0c9412de, name: DatasetName { kind: CockroachDb, pool_name: ZpoolName("oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:101::4]:32221" }), id: 237e1ccf-9c97-48c5-bdd2-06af0c9412de, services: [ServiceZoneService { details: CockroachDb { address: "[fd00:1122:3344:101::4]:32221" }, id: 237e1ccf-9c97-48c5-bdd2-06af0c9412de }], zone_type: CockroachDb }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::5], dataset: Some(DatasetRequest { id: 14a002ac-4996-43b3-92d5-ecae98936197, name: DatasetName { kind: CockroachDb, pool_name: ZpoolName("oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7") }, service_address: "[fd00:1122:3344:101::5]:32221" }), id: 14a002ac-4996-43b3-92d5-ecae98936197, services: [ServiceZoneService { details: CockroachDb { address: "[fd00:1122:3344:101::5]:32221" }, id: 14a002ac-4996-43b3-92d5-ecae98936197 }], zone_type: CockroachDb }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::6], dataset: Some(DatasetRequest { id: f207d0a2-721a-48a5-8439-beab99cf8636, name: DatasetName { kind: CockroachDb, pool_name: ZpoolName("oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60") }, service_address: "[fd00:1122:3344:101::6]:32221" }), id: f207d0a2-721a-48a5-8439-beab99cf8636, services: [ServiceZoneService { details: CockroachDb { address: "[fd00:1122:3344:101::6]:32221" }, id: f207d0a2-721a-48a5-8439-beab99cf8636 }], zone_type: CockroachDb }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::7], dataset: Some(DatasetRequest { id: 6dd2ceaa-bb97-452d-b091-627d2fb3ff54, name: DatasetName { kind: CockroachDb, pool_name: ZpoolName("oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:101::7]:32221" }), id: 6dd2ceaa-bb97-452d-b091-627d2fb3ff54, services: [ServiceZoneService { details: CockroachDb { address: "[fd00:1122:3344:101::7]:32221" }, id: 6dd2ceaa-bb97-452d-b091-627d2fb3ff54 }], zone_type: CockroachDb }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::8], dataset: Some(DatasetRequest { id: 3982ba39-4a3c-46be-b1d4-f0505bc72832, name: DatasetName { kind: ExternalDns, pool_name: ZpoolName("oxp_31bd71cd-4736-4a12-a387-9b74b050396f") }, service_address: "[fd00:1122:3344:101::8]:5353" }), id: 3982ba39-4a3c-46be-b1d4-f0505bc72832, services: [ServiceZoneService { details: ExternalDns { dns_address: "10.151.1.164:53", http_address: "[fd00:1122:3344:101::8]:5353", nic: NetworkInterface { id: 8838b9ad-45a0-4080-b0f1-423b9685a5f9, ip: 172.30.1.5, kind: Service(3982ba39-4a3c-46be-b1d4-f0505bc72832), mac: MacAddr("A8:40:25:FF:BC:FB"), name: Name("external-dns-3982ba39-4a3c-46be-b1d4-f0505bc72832"), primary: true, slot: 0, subnet: V4(Ipv4Net("172.30.1.0/24")), vni: Vni(100) } }, id: 3982ba39-4a3c-46be-b1d4-f0505bc72832 }], zone_type: ExternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::9], dataset: Some(DatasetRequest { id: f840ab86-b51b-4dfc-87f5-1e94da606b2f, name: DatasetName { kind: ExternalDns, pool_name: ZpoolName("oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:101::9]:5353" }), id: f840ab86-b51b-4dfc-87f5-1e94da606b2f, services: [ServiceZoneService { details: ExternalDns { dns_address: "10.151.1.165:53", http_address: "[fd00:1122:3344:101::9]:5353", nic: NetworkInterface { id: d312aa34-798e-49f0-b8f7-059dd74f3904, ip: 172.30.1.6, kind: Service(f840ab86-b51b-4dfc-87f5-1e94da606b2f), mac: MacAddr("A8:40:25:FF:ED:C3"), name: Name("external-dns-f840ab86-b51b-4dfc-87f5-1e94da606b2f"), primary: true, slot: 0, subnet: V4(Ipv4Net("172.30.1.0/24")), vni: Vni(100) } }, id: f840ab86-b51b-4dfc-87f5-1e94da606b2f }], zone_type: ExternalDns }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::a], dataset: None, id: b023678b-9619-4790-b197-c706bb2ff170, services: [ServiceZoneService { details: Nexus { external_dns_servers: [1.1.1.1, 9.9.9.9], external_ip: 10.151.1.166, external_tls: true, internal_address: "[fd00:1122:3344:101::a]:12221", nic: NetworkInterface { id: 827e197c-8d97-41cd-9226-3b4c742270bd, ip: 172.30.2.5, kind: Service(b023678b-9619-4790-b197-c706bb2ff170), mac: MacAddr("A8:40:25:FF:8C:4A"), name: Name("nexus-b023678b-9619-4790-b197-c706bb2ff170"), primary: true, slot: 0, subnet: V4(Ipv4Net("172.30.2.0/24")), vni: Vni(100) } }, id: b023678b-9619-4790-b197-c706bb2ff170 }], zone_type: Nexus }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::b], dataset: None, id: 8e413664-c870-4e1d-9bd8-441f1c8249bc, services: [ServiceZoneService { details: Nexus { external_dns_servers: [1.1.1.1, 9.9.9.9], external_ip: 10.151.1.167, external_tls: true, internal_address: "[fd00:1122:3344:101::b]:12221", nic: NetworkInterface { id: 7f19b2c5-ab60-4929-9e6a-01f96699cb00, ip: 172.30.2.6, kind: Service(8e413664-c870-4e1d-9bd8-441f1c8249bc), mac: MacAddr("A8:40:25:FF:FD:20"), name: Name("nexus-8e413664-c870-4e1d-9bd8-441f1c8249bc"), primary: true, slot: 0, subnet: V4(Ipv4Net("172.30.2.0/24")), vni: Vni(100) } }, id: 8e413664-c870-4e1d-9bd8-441f1c8249bc }], zone_type: Nexus }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::c], dataset: None, id: b2e743e1-ac6b-4306-a859-2ab1114b836a, services: [ServiceZoneService { details: Nexus { external_dns_servers: [1.1.1.1, 9.9.9.9], external_ip: 10.151.1.168, external_tls: true, internal_address: "[fd00:1122:3344:101::c]:12221", nic: NetworkInterface { id: c384af75-38b2-451e-ba52-5a5615fce723, ip: 172.30.2.7, kind: Service(b2e743e1-ac6b-4306-a859-2ab1114b836a), mac: MacAddr("A8:40:25:FF:9E:FA"), name: Name("nexus-b2e743e1-ac6b-4306-a859-2ab1114b836a"), primary: true, slot: 0, subnet: V4(Ipv4Net("172.30.2.0/24")), vni: Vni(100) } }, id: b2e743e1-ac6b-4306-a859-2ab1114b836a }], zone_type: Nexus }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::d], dataset: None, id: 3e3f164a-de35-4de8-a1bc-1a8d70df38c4, services: [ServiceZoneService { details: Oximeter { address: "[fd00:1122:3344:101::d]:12223" }, id: 3e3f164a-de35-4de8-a1bc-1a8d70df38c4 }], zone_type: Oximeter }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::e], dataset: Some(DatasetRequest { id: 30153f90-1fce-4f1d-a7cc-a160a8286745, name: DatasetName { kind: Clickhouse, pool_name: ZpoolName("oxp_31bd71cd-4736-4a12-a387-9b74b050396f") }, service_address: "[fd00:1122:3344:101::e]:8123" }), id: 30153f90-1fce-4f1d-a7cc-a160a8286745, services: [ServiceZoneService { details: Clickhouse { address: "[fd00:1122:3344:101::e]:8123" }, id: 30153f90-1fce-4f1d-a7cc-a160a8286745 }], zone_type: Clickhouse }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::f], dataset: None, id: c69b0abd-69bf-4441-b75b-7a922e5e21aa, services: [ServiceZoneService { details: CruciblePantry { address: "[fd00:1122:3344:101::f]:17000" }, id: c69b0abd-69bf-4441-b75b-7a922e5e21aa }], zone_type: CruciblePantry }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::10], dataset: None, id: 37b2e6d9-6cb2-4beb-a5d7-3d31f3719977, services: [ServiceZoneService { details: CruciblePantry { address: "[fd00:1122:3344:101::10]:17000" }, id: 37b2e6d9-6cb2-4beb-a5d7-3d31f3719977 }], zone_type: CruciblePantry }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::11], dataset: None, id: 50266584-65cc-4749-90f5-03bc0b287e1a, services: [ServiceZoneService { details: CruciblePantry { address: "[fd00:1122:3344:101::11]:17000" }, id: 50266584-65cc-4749-90f5-03bc0b287e1a }], zone_type: CruciblePantry }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::12], dataset: Some(DatasetRequest { id: a96a5506-7b52-4625-ab6d-ab75e188beea, name: DatasetName { kind: Crucible, pool_name: ZpoolName("oxp_31bd71cd-4736-4a12-a387-9b74b050396f") }, service_address: "[fd00:1122:3344:101::12]:32345" }), id: a96a5506-7b52-4625-ab6d-ab75e188beea, services: [ServiceZoneService { details: Crucible { address: "[fd00:1122:3344:101::12]:32345" }, id: a96a5506-7b52-4625-ab6d-ab75e188beea }], zone_type: Crucible }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::13], dataset: Some(DatasetRequest { id: d7ca13eb-fdb6-4c57-9d57-0d46d1616447, name: DatasetName { kind: Crucible, pool_name: ZpoolName("oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:101::13]:32345" }), id: d7ca13eb-fdb6-4c57-9d57-0d46d1616447, services: [ServiceZoneService { details: Crucible { address: "[fd00:1122:3344:101::13]:32345" }, id: d7ca13eb-fdb6-4c57-9d57-0d46d1616447 }], zone_type: Crucible }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::14], dataset: Some(DatasetRequest { id: 66dae034-34bf-419a-9679-63da99019e56, name: DatasetName { kind: Crucible, pool_name: ZpoolName("oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7") }, service_address: "[fd00:1122:3344:101::14]:32345" }), id: 66dae034-34bf-419a-9679-63da99019e56, services: [ServiceZoneService { details: Crucible { address: "[fd00:1122:3344:101::14]:32345" }, id: 66dae034-34bf-419a-9679-63da99019e56 }], zone_type: Crucible }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::15], dataset: Some(DatasetRequest { id: ae15ceaa-bd15-472e-9980-f9899a74fd71, name: DatasetName { kind: Crucible, pool_name: ZpoolName("oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60") }, service_address: "[fd00:1122:3344:101::15]:32345" }), id: ae15ceaa-bd15-472e-9980-f9899a74fd71, services: [ServiceZoneService { details: Crucible { address: "[fd00:1122:3344:101::15]:32345" }, id: ae15ceaa-bd15-472e-9980-f9899a74fd71 }], zone_type: Crucible }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::16], dataset: Some(DatasetRequest { id: 68e17930-c4e8-46a4-b943-ce2dfb9c32f7, name: DatasetName { kind: Crucible, pool_name: ZpoolName("oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:101::16]:32345" }), id: 68e17930-c4e8-46a4-b943-ce2dfb9c32f7, services: [ServiceZoneService { details: Crucible { address: "[fd00:1122:3344:101::16]:32345" }, id: 68e17930-c4e8-46a4-b943-ce2dfb9c32f7 }], zone_type: Crucible }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::17], dataset: Some(DatasetRequest { id: 44a4726c-52f3-4e02-8693-d4a73a0edc01, name: DatasetName { kind: Crucible, pool_name: ZpoolName("oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:101::17]:32345" }), id: 44a4726c-52f3-4e02-8693-d4a73a0edc01, services: [ServiceZoneService { details: Crucible { address: "[fd00:1122:3344:101::17]:32345" }, id: 44a4726c-52f3-4e02-8693-d4a73a0edc01 }], zone_type: Crucible }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::18], dataset: Some(DatasetRequest { id: bdeabda1-0efa-4bfe-bfa6-fe98d421d013, name: DatasetName { kind: Crucible, pool_name: ZpoolName("oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b") }, service_address: "[fd00:1122:3344:101::18]:32345" }), id: bdeabda1-0efa-4bfe-bfa6-fe98d421d013, services: [ServiceZoneService { details: Crucible { address: "[fd00:1122:3344:101::18]:32345" }, id: bdeabda1-0efa-4bfe-bfa6-fe98d421d013 }], zone_type: Crucible }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::19], dataset: Some(DatasetRequest { id: 8f2b6ec7-09eb-4cc0-b44a-b1b0c56c1b60, name: DatasetName { kind: Crucible, pool_name: ZpoolName("oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930") }, service_address: "[fd00:1122:3344:101::19]:32345" }), id: 8f2b6ec7-09eb-4cc0-b44a-b1b0c56c1b60, services: [ServiceZoneService { details: Crucible { address: "[fd00:1122:3344:101::19]:32345" }, id: 8f2b6ec7-09eb-4cc0-b44a-b1b0c56c1b60 }], zone_type: Crucible }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::1a], dataset: Some(DatasetRequest { id: 6eead47c-e516-4cfb-b7a6-4469a75c6c3f, name: DatasetName { kind: Crucible, pool_name: ZpoolName("oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03") }, service_address: "[fd00:1122:3344:101::1a]:32345" }), id: 6eead47c-e516-4cfb-b7a6-4469a75c6c3f, services: [ServiceZoneService { details: Crucible { address: "[fd00:1122:3344:101::1a]:32345" }, id: 6eead47c-e516-4cfb-b7a6-4469a75c6c3f }], zone_type: Crucible }, ServiceZoneRequest { addresses: [fd00:1122:3344:101::1b], dataset: None, id: 53a0e933-3473-4a9f-b17a-039ac7ee8915, services: [ServiceZoneService { details: BoundaryNtp { address: "[fd00:1122:3344:101::1b]:123", dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0a6f5d02-3be4-4692-be87-916d30e598ad, ip: 172.30.3.5, kind: Service(53a0e933-3473-4a9f-b17a-039ac7ee8915), mac: MacAddr("A8:40:25:FF:B8:73"), name: Name("ntp-53a0e933-3473-4a9f-b17a-039ac7ee8915"), primary: true, slot: 0, subnet: V4(Ipv4Net("172.30.3.0/24")), vni: Vni(100) }, ntp_servers: ["0.pool.ntp.org"], snat_cfg: SourceNatConfig { first_port: 0, ip: 10.151.1.169, last_port: 16383 } }, id: 53a0e933-3473-4a9f-b17a-039ac7ee8915 }], zone_type: Ntp }] file = sled-agent/src/rack_setup/service.rs:284
4402023-09-20T03:49:44.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38046
4412023-09-20T03:49:44.608ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a5db5e2c-8e54-4f39-9689-3ea4f264af81, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4422023-09-20T03:49:44.636ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a29497ec-9b94-42a0-9136-a20c59f4c77e, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4432023-09-20T03:49:44.659ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a296927f-5e12-488a-867b-511d5864f1fe, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: InternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4442023-09-20T03:49:44.682ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: e2efcbab-f26d-427a-9878-d9bbcbd54b26, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4452023-09-20T03:49:44.704ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 237e1ccf-9c97-48c5-bdd2-06af0c9412de, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4462023-09-20T03:49:44.728ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 14a002ac-4996-43b3-92d5-ecae98936197, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4472023-09-20T03:49:44.752ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: f207d0a2-721a-48a5-8439-beab99cf8636, dataset_name: DatasetName { pool_name: ZpoolName { id: ceb4461c-cf56-4719-ad3c-14430bfdfb60, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4482023-09-20T03:49:44.777ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 6dd2ceaa-bb97-452d-b091-627d2fb3ff54, dataset_name: DatasetName { pool_name: ZpoolName { id: e4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: CockroachDb }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4492023-09-20T03:49:44.802ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 3982ba39-4a3c-46be-b1d4-f0505bc72832, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: ExternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4502023-09-20T03:49:44.894ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: f840ab86-b51b-4dfc-87f5-1e94da606b2f, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: ExternalDns }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4512023-09-20T03:49:45.900ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
4522023-09-20T03:49:48.359ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 30153f90-1fce-4f1d-a7cc-a160a8286745, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: Clickhouse }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4532023-09-20T03:49:48.518ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: a96a5506-7b52-4625-ab6d-ab75e188beea, dataset_name: DatasetName { pool_name: ZpoolName { id: 31bd71cd-4736-4a12-a387-9b74b050396f, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4542023-09-20T03:49:48.697ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: d7ca13eb-fdb6-4c57-9d57-0d46d1616447, dataset_name: DatasetName { pool_name: ZpoolName { id: 24b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4552023-09-20T03:49:48.886ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 66dae034-34bf-419a-9679-63da99019e56, dataset_name: DatasetName { pool_name: ZpoolName { id: 616b26df-e62a-4c68-b506-f4a923d8aaf7, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4562023-09-20T03:49:49.055ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: ae15ceaa-bd15-472e-9980-f9899a74fd71, dataset_name: DatasetName { pool_name: ZpoolName { id: ceb4461c-cf56-4719-ad3c-14430bfdfb60, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4572023-09-20T03:49:49.247ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 68e17930-c4e8-46a4-b943-ce2dfb9c32f7, dataset_name: DatasetName { pool_name: ZpoolName { id: e4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4582023-09-20T03:49:49.423ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 44a4726c-52f3-4e02-8693-d4a73a0edc01, dataset_name: DatasetName { pool_name: ZpoolName { id: 14b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4592023-09-20T03:49:49.614ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: bdeabda1-0efa-4bfe-bfa6-fe98d421d013, dataset_name: DatasetName { pool_name: ZpoolName { id: d462a7f7-b628-40fe-80ff-4e4189e2d62b, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4602023-09-20T03:49:49.819ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 8f2b6ec7-09eb-4cc0-b44a-b1b0c56c1b60, dataset_name: DatasetName { pool_name: ZpoolName { id: cd70d7f6-2354-4bf2-8012-55bf9eaf7930, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4612023-09-20T03:49:49.956ZINFOSledAgent (StorageManager): add_dataset: NewFilesystemRequest { dataset_id: 6eead47c-e516-4cfb-b7a6-4469a75c6c3f, dataset_name: DatasetName { pool_name: ZpoolName { id: f4b4dc87-ab46-49fb-a4b4-d361ae214c03, kind: External }, kind: Crucible }, responder: Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: true, is_tx_task_set: false } }) } } file = sled-agent/src/storage_manager.rs:1004
4622023-09-20T03:49:50.319ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:241
4632023-09-20T03:49:50.320ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:241
4642023-09-20T03:49:50.364ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:241
4652023-09-20T03:49:50.365ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:241
4662023-09-20T03:49:50.366ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:241
4672023-09-20T03:49:50.431ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_3e3f164a-de35-4de8-a1bc-1a8d70df38c4 file = illumos-utils/src/zone.rs:314
4682023-09-20T03:49:50.437ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_37b2e6d9-6cb2-4beb-a5d7-3d31f3719977 file = illumos-utils/src/zone.rs:314
4692023-09-20T03:49:50.442ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a96a5506-7b52-4625-ab6d-ab75e188beea file = illumos-utils/src/zone.rs:314
4702023-09-20T03:49:50.447ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6eead47c-e516-4cfb-b7a6-4469a75c6c3f file = illumos-utils/src/zone.rs:314
4712023-09-20T03:49:50.452ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_44a4726c-52f3-4e02-8693-d4a73a0edc01 file = illumos-utils/src/zone.rs:314
4722023-09-20T03:49:50.457ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_68e17930-c4e8-46a4-b943-ce2dfb9c32f7 file = illumos-utils/src/zone.rs:314
4732023-09-20T03:49:50.462ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8f2b6ec7-09eb-4cc0-b44a-b1b0c56c1b60 file = illumos-utils/src/zone.rs:314
4742023-09-20T03:49:50.467ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_30153f90-1fce-4f1d-a7cc-a160a8286745 file = illumos-utils/src/zone.rs:314
4752023-09-20T03:49:50.472ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_50266584-65cc-4749-90f5-03bc0b287e1a file = illumos-utils/src/zone.rs:314
4762023-09-20T03:49:50.478ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_c69b0abd-69bf-4441-b75b-7a922e5e21aa file = illumos-utils/src/zone.rs:314
4772023-09-20T03:49:50.483ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ae15ceaa-bd15-472e-9980-f9899a74fd71 file = illumos-utils/src/zone.rs:314
4782023-09-20T03:49:50.489ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_3e3f164a-de35-4de8-a1bc-1a8d70df38c4 file = illumos-utils/src/zone.rs:353
4792023-09-20T03:49:50.494ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_37b2e6d9-6cb2-4beb-a5d7-3d31f3719977 file = illumos-utils/src/zone.rs:353
4802023-09-20T03:49:50.499ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a96a5506-7b52-4625-ab6d-ab75e188beea file = illumos-utils/src/zone.rs:353
4812023-09-20T03:49:50.504ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6eead47c-e516-4cfb-b7a6-4469a75c6c3f file = illumos-utils/src/zone.rs:353
4822023-09-20T03:49:50.509ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_44a4726c-52f3-4e02-8693-d4a73a0edc01 file = illumos-utils/src/zone.rs:353
4832023-09-20T03:49:50.514ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_68e17930-c4e8-46a4-b943-ce2dfb9c32f7 file = illumos-utils/src/zone.rs:353
4842023-09-20T03:49:50.518ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8f2b6ec7-09eb-4cc0-b44a-b1b0c56c1b60 file = illumos-utils/src/zone.rs:353
4852023-09-20T03:49:50.523ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_30153f90-1fce-4f1d-a7cc-a160a8286745 file = illumos-utils/src/zone.rs:353
4862023-09-20T03:49:50.528ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_50266584-65cc-4749-90f5-03bc0b287e1a file = illumos-utils/src/zone.rs:353
4872023-09-20T03:49:50.534ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_c69b0abd-69bf-4441-b75b-7a922e5e21aa file = illumos-utils/src/zone.rs:353
4882023-09-20T03:49:50.540ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ae15ceaa-bd15-472e-9980-f9899a74fd71 file = illumos-utils/src/zone.rs:353
4892023-09-20T03:49:50.546ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d7ca13eb-fdb6-4c57-9d57-0d46d1616447 file = illumos-utils/src/zone.rs:314
4902023-09-20T03:49:50.552ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_66dae034-34bf-419a-9679-63da99019e56 file = illumos-utils/src/zone.rs:314
4912023-09-20T03:49:50.557ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bdeabda1-0efa-4bfe-bfa6-fe98d421d013 file = illumos-utils/src/zone.rs:314
4922023-09-20T03:49:50.605ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:258
4932023-09-20T03:49:50.640ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:258
4942023-09-20T03:49:50.640ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d7ca13eb-fdb6-4c57-9d57-0d46d1616447 file = illumos-utils/src/zone.rs:353
4952023-09-20T03:49:50.646ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_66dae034-34bf-419a-9679-63da99019e56 file = illumos-utils/src/zone.rs:353
4962023-09-20T03:49:50.651ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bdeabda1-0efa-4bfe-bfa6-fe98d421d013 file = illumos-utils/src/zone.rs:353
4972023-09-20T03:49:50.691ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:258
4982023-09-20T03:49:50.728ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:258
4992023-09-20T03:49:50.761ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:258
5002023-09-20T03:49:50.765ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:283
5012023-09-20T03:49:50.765ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:175
5022023-09-20T03:49:50.821ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:376 port = Port { inner: PortInner { name: "opte1", _ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 188, 251]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte1" } }
5032023-09-20T03:49:50.821ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:881 service = ServiceZoneService { id: 3982ba39-4a3c-46be-b1d4-f0505bc72832, details: ExternalDns { http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 8838b9ad-45a0-4080-b0f1-423b9685a5f9, kind: Service { id: 3982ba39-4a3c-46be-b1d4-f0505bc72832 }, name: Name("external-dns-3982ba39-4a3c-46be-b1d4-f0505bc72832"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 251])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }
5042023-09-20T03:49:50.823ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:283
5052023-09-20T03:49:50.823ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:175
5062023-09-20T03:49:50.880ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:376 port = Port { inner: PortInner { name: "opte2", _ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 253, 32]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte2" } }
5072023-09-20T03:49:50.880ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:881 service = ServiceZoneService { id: 8e413664-c870-4e1d-9bd8-441f1c8249bc, details: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 7f19b2c5-ab60-4929-9e6a-01f96699cb00, kind: Service { id: 8e413664-c870-4e1d-9bd8-441f1c8249bc }, name: Name("nexus-8e413664-c870-4e1d-9bd8-441f1c8249bc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 32])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }
5082023-09-20T03:49:50.882ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:283
5092023-09-20T03:49:50.882ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:175
5102023-09-20T03:49:50.888ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5112023-09-20T03:49:50.944ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:376 port = Port { inner: PortInner { name: "opte3", _ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 140, 74]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte3" } }
5122023-09-20T03:49:50.944ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:881 service = ServiceZoneService { id: b023678b-9619-4790-b197-c706bb2ff170, details: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 827e197c-8d97-41cd-9226-3b4c742270bd, kind: Service { id: b023678b-9619-4790-b197-c706bb2ff170 }, name: Name("nexus-b023678b-9619-4790-b197-c706bb2ff170"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }
5132023-09-20T03:49:50.946ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:283
5142023-09-20T03:49:50.946ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:175
5152023-09-20T03:49:50.998ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:376 port = Port { inner: PortInner { name: "opte4", _ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 237, 195]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte4" } }
5162023-09-20T03:49:50.998ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:881 service = ServiceZoneService { id: f840ab86-b51b-4dfc-87f5-1e94da606b2f, details: ExternalDns { http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: d312aa34-798e-49f0-b8f7-059dd74f3904, kind: Service { id: f840ab86-b51b-4dfc-87f5-1e94da606b2f }, name: Name("external-dns-f840ab86-b51b-4dfc-87f5-1e94da606b2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 195])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }
5172023-09-20T03:49:51.000ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:283
5182023-09-20T03:49:51.000ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:175
5192023-09-20T03:49:51.054ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:376 port = Port { inner: PortInner { name: "opte5", _ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 158, 250]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte5" } }
5202023-09-20T03:49:51.054ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:881 service = ServiceZoneService { id: b2e743e1-ac6b-4306-a859-2ab1114b836a, details: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: c384af75-38b2-451e-ba52-5a5615fce723, kind: Service { id: b2e743e1-ac6b-4306-a859-2ab1114b836a }, name: Name("nexus-b2e743e1-ac6b-4306-a859-2ab1114b836a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 250])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }
5212023-09-20T03:49:51.056ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.164, prefix: 32, }, ) file = dpd-client/src/lib.rs:98
5222023-09-20T03:49:51.056ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.164, prefix: 32, }, ) file = dpd-client/src/lib.rs:105
5232023-09-20T03:49:51.056ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.168, prefix: 32, }, ) file = dpd-client/src/lib.rs:98
5242023-09-20T03:49:51.056ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.168, prefix: 32, }, ) file = dpd-client/src/lib.rs:105
5252023-09-20T03:49:51.056ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.167, prefix: 32, }, ) file = dpd-client/src/lib.rs:98
5262023-09-20T03:49:51.056ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.167, prefix: 32, }, ) file = dpd-client/src/lib.rs:105
5272023-09-20T03:49:51.056ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.166, prefix: 32, }, ) file = dpd-client/src/lib.rs:98
5282023-09-20T03:49:51.056ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.166, prefix: 32, }, ) file = dpd-client/src/lib.rs:105
5292023-09-20T03:49:51.057ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.165, prefix: 32, }, ) file = dpd-client/src/lib.rs:98
5302023-09-20T03:49:51.057ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.165, prefix: 32, }, ) file = dpd-client/src/lib.rs:105
5312023-09-20T03:49:51.058ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.164, prefix: 32, }, ) file = dpd-client/src/lib.rs:133
5322023-09-20T03:49:51.088ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.167, prefix: 32, }, ) file = dpd-client/src/lib.rs:133
5332023-09-20T03:49:51.118ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.166, prefix: 32, }, ) file = dpd-client/src/lib.rs:133
5342023-09-20T03:49:51.146ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.165, prefix: 32, }, ) file = dpd-client/src/lib.rs:133
5352023-09-20T03:49:51.174ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.168, prefix: 32, }, ) file = dpd-client/src/lib.rs:133
5362023-09-20T03:49:51.202ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_3982ba39-4a3c-46be-b1d4-f0505bc72832 file = illumos-utils/src/zone.rs:314
5372023-09-20T03:49:51.209ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8e413664-c870-4e1d-9bd8-441f1c8249bc file = illumos-utils/src/zone.rs:314
5382023-09-20T03:49:51.215ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b023678b-9619-4790-b197-c706bb2ff170 file = illumos-utils/src/zone.rs:314
5392023-09-20T03:49:51.221ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f840ab86-b51b-4dfc-87f5-1e94da606b2f file = illumos-utils/src/zone.rs:314
5402023-09-20T03:49:51.226ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b2e743e1-ac6b-4306-a859-2ab1114b836a file = illumos-utils/src/zone.rs:314
5412023-09-20T03:49:51.233ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_3982ba39-4a3c-46be-b1d4-f0505bc72832 file = illumos-utils/src/zone.rs:353
5422023-09-20T03:49:51.241ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8e413664-c870-4e1d-9bd8-441f1c8249bc file = illumos-utils/src/zone.rs:353
5432023-09-20T03:49:51.247ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b023678b-9619-4790-b197-c706bb2ff170 file = illumos-utils/src/zone.rs:353
5442023-09-20T03:49:51.254ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f840ab86-b51b-4dfc-87f5-1e94da606b2f file = illumos-utils/src/zone.rs:353
5452023-09-20T03:49:51.260ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b2e743e1-ac6b-4306-a859-2ab1114b836a file = illumos-utils/src/zone.rs:353
5462023-09-20T03:49:52.806ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_oximeter_3e3f164a-de35-4de8-a1bc-1a8d70df38c4
5472023-09-20T03:49:52.841ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_37b2e6d9-6cb2-4beb-a5d7-3d31f3719977: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5482023-09-20T03:49:52.841ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_pantry_37b2e6d9-6cb2-4beb-a5d7-3d31f3719977
5492023-09-20T03:49:52.976ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_c69b0abd-69bf-4441-b75b-7a922e5e21aa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5502023-09-20T03:49:52.977ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_pantry_c69b0abd-69bf-4441-b75b-7a922e5e21aa
5512023-09-20T03:49:53.083ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_50266584-65cc-4749-90f5-03bc0b287e1a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5522023-09-20T03:49:53.084ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_pantry_50266584-65cc-4749-90f5-03bc0b287e1a
5532023-09-20T03:49:53.216ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a96a5506-7b52-4625-ab6d-ab75e188beea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_31bd71cd-4736-4a12-a387-9b74b050396f/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="31ea0b68-124f-4051-8829-04b3eb1ce00d"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5542023-09-20T03:49:53.218ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_a96a5506-7b52-4625-ab6d-ab75e188beea
5552023-09-20T03:49:53.496ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_44a4726c-52f3-4e02-8693-d4a73a0edc01: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="fb855aa0-9cd6-4fbb-9f37-8ef153a01adc"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5562023-09-20T03:49:53.498ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_44a4726c-52f3-4e02-8693-d4a73a0edc01
5572023-09-20T03:49:53.979ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ae15ceaa-bd15-472e-9980-f9899a74fd71: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_ceb4461c-cf56-4719-ad3c-14430bfdfb60/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="98860e50-64e8-4024-9428-5c898ddb4722"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5582023-09-20T03:49:53.980ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6eead47c-e516-4cfb-b7a6-4469a75c6c3f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="3171036b-3ddf-46f7-a319-996503345dd0"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5592023-09-20T03:49:53.980ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_ae15ceaa-bd15-472e-9980-f9899a74fd71
5602023-09-20T03:49:53.989ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_66dae034-34bf-419a-9679-63da99019e56: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="0c6f47c9-6fdc-45bb-b3ff-46752b2ef2e6"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5612023-09-20T03:49:53.989ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_6eead47c-e516-4cfb-b7a6-4469a75c6c3f
5622023-09-20T03:49:54.000ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_66dae034-34bf-419a-9679-63da99019e56
5632023-09-20T03:49:54.155ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bdeabda1-0efa-4bfe-bfa6-fe98d421d013: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_d462a7f7-b628-40fe-80ff-4e4189e2d62b/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="67bde7ba-a5c9-4553-980b-f8c8aa82a23c"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5642023-09-20T03:49:54.155ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_bdeabda1-0efa-4bfe-bfa6-fe98d421d013
5652023-09-20T03:49:54.170ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d7ca13eb-fdb6-4c57-9d57-0d46d1616447: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="d554607f-2fcd-49e8-9c3c-fd20ac76061f"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5662023-09-20T03:49:54.170ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_d7ca13eb-fdb6-4c57-9d57-0d46d1616447
5672023-09-20T03:49:54.819ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43705
5682023-09-20T03:49:54.819ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 144 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43705 req_id = a5c47127-4db3-4654-a2d7-a1e5386537a3 response_code = 200 uri = /baseboard
5692023-09-20T03:49:55.802ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_30153f90-1fce-4f1d-a7cc-a160a8286745: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5702023-09-20T03:49:55.802ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_clickhouse_30153f90-1fce-4f1d-a7cc-a160a8286745
5712023-09-20T03:49:55.875ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5722023-09-20T03:50:00.863ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5732023-09-20T03:50:02.636ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8f2b6ec7-09eb-4cc0-b44a-b1b0c56c1b60: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="6e6ecb4e-fb1d-4d25-8227-08a8addb0f59"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5742023-09-20T03:50:02.637ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_8f2b6ec7-09eb-4cc0-b44a-b1b0c56c1b60
5752023-09-20T03:50:02.663ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_68e17930-c4e8-46a4-b943-ce2dfb9c32f7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="dataset" value="oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="f3639166-ce70-488e-b0cf-272791f05891"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5762023-09-20T03:50:02.663ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_crucible_68e17930-c4e8-46a4-b943-ce2dfb9c32f7
5772023-09-20T03:50:02.919ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_external_dns_3982ba39-4a3c-46be-b1d4-f0505bc72832
5782023-09-20T03:50:03.418ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_nexus_b023678b-9619-4790-b197-c706bb2ff170
5792023-09-20T03:50:05.607ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_external_dns_f840ab86-b51b-4dfc-87f5-1e94da606b2f
5802023-09-20T03:50:05.850ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5812023-09-20T03:50:05.990ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_nexus_8e413664-c870-4e1d-9bd8-441f1c8249bc
5822023-09-20T03:50:06.017ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 zone = oxz_nexus_b2e743e1-ac6b-4306-a859-2ab1114b836a
5832023-09-20T03:50:10.838ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5842023-09-20T03:50:15.837ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5852023-09-20T03:50:20.831ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5862023-09-20T03:50:24.772ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64893
5872023-09-20T03:50:24.772ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64893 req_id = a247cc3e-cb92-47fb-b23b-b24847de6915 response_code = 200 uri = /baseboard
5882023-09-20T03:50:25.836ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5892023-09-20T03:50:25.878ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::9 exists file = sled-agent/src/services.rs:1358
5902023-09-20T03:50:25.878ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::9, prefix: 64 })) file = illumos-utils/src/running_zone.rs:602 zone = oxz_external_dns_f840ab86-b51b-4dfc-87f5-1e94da606b2f
5912023-09-20T03:50:26.667ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::9 exists - OK file = sled-agent/src/services.rs:1366
5922023-09-20T03:50:26.667ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1387
5932023-09-20T03:50:28.242ZINFOSledAgent (ServiceManager): Setting up external-dns service file = sled-agent/src/services.rs:1523
5942023-09-20T03:50:28.242ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:646 zone = oxz_external_dns_f840ab86-b51b-4dfc-87f5-1e94da606b2f
5952023-09-20T03:50:30.824ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
5962023-09-20T03:50:33.670ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::c exists file = sled-agent/src/services.rs:1358
5972023-09-20T03:50:33.670ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::c, prefix: 64 })) file = illumos-utils/src/running_zone.rs:602 zone = oxz_nexus_b2e743e1-ac6b-4306-a859-2ab1114b836a
5982023-09-20T03:50:34.218ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::c exists - OK file = sled-agent/src/services.rs:1366
5992023-09-20T03:50:34.218ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1387
6002023-09-20T03:50:34.485ZINFOSledAgent (ServiceManager): Setting up Nexus service file = sled-agent/src/services.rs:1429
6012023-09-20T03:50:34.485ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:646 zone = oxz_nexus_b2e743e1-ac6b-4306-a859-2ab1114b836a
6022023-09-20T03:50:35.811ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6032023-09-20T03:50:40.412ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::d exists file = sled-agent/src/services.rs:1358
6042023-09-20T03:50:40.412ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::d, prefix: 64 })) file = illumos-utils/src/running_zone.rs:602 zone = oxz_oximeter_3e3f164a-de35-4de8-a1bc-1a8d70df38c4
6052023-09-20T03:50:40.800ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6062023-09-20T03:50:40.963ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::d exists - OK file = sled-agent/src/services.rs:1366
6072023-09-20T03:50:40.963ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1387
6082023-09-20T03:50:41.159ZINFOSledAgent (ServiceManager): Setting up oximeter service file = sled-agent/src/services.rs:1622
6092023-09-20T03:50:41.237ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::8 exists file = sled-agent/src/services.rs:1358
6102023-09-20T03:50:41.237ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::8, prefix: 64 })) file = illumos-utils/src/running_zone.rs:602 zone = oxz_external_dns_3982ba39-4a3c-46be-b1d4-f0505bc72832
6112023-09-20T03:50:41.790ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::8 exists - OK file = sled-agent/src/services.rs:1366
6122023-09-20T03:50:41.791ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1387
6132023-09-20T03:50:41.968ZINFOSledAgent (ServiceManager): Setting up external-dns service file = sled-agent/src/services.rs:1523
6142023-09-20T03:50:41.969ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:646 zone = oxz_external_dns_3982ba39-4a3c-46be-b1d4-f0505bc72832
6152023-09-20T03:50:45.788ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6162023-09-20T03:50:48.109ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::b exists file = sled-agent/src/services.rs:1358
6172023-09-20T03:50:48.109ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::b, prefix: 64 })) file = illumos-utils/src/running_zone.rs:602 zone = oxz_nexus_8e413664-c870-4e1d-9bd8-441f1c8249bc
6182023-09-20T03:50:48.666ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::b exists - OK file = sled-agent/src/services.rs:1366
6192023-09-20T03:50:48.666ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1387
6202023-09-20T03:50:48.863ZINFOSledAgent (ServiceManager): Setting up Nexus service file = sled-agent/src/services.rs:1429
6212023-09-20T03:50:48.863ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:646 zone = oxz_nexus_8e413664-c870-4e1d-9bd8-441f1c8249bc
6222023-09-20T03:50:50.776ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6232023-09-20T03:50:54.725ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40951
6242023-09-20T03:50:54.725ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 527 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40951 req_id = fe97d326-bc5d-44bc-b282-2e00efcb394d response_code = 200 uri = /baseboard
6252023-09-20T03:50:55.272ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::a exists file = sled-agent/src/services.rs:1358
6262023-09-20T03:50:55.273ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::a, prefix: 64 })) file = illumos-utils/src/running_zone.rs:602 zone = oxz_nexus_b023678b-9619-4790-b197-c706bb2ff170
6272023-09-20T03:50:55.765ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6282023-09-20T03:50:55.830ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::a exists - OK file = sled-agent/src/services.rs:1366
6292023-09-20T03:50:55.830ZINFOSledAgent (ServiceManager): Zone using sled underlay as gateway file = sled-agent/src/services.rs:1387
6302023-09-20T03:50:56.024ZINFOSledAgent (ServiceManager): Setting up Nexus service file = sled-agent/src/services.rs:1429
6312023-09-20T03:50:56.024ZINFOSledAgent (ServiceManager): Ensuring address for OPTE port file = illumos-utils/src/running_zone.rs:646 zone = oxz_nexus_b023678b-9619-4790-b197-c706bb2ff170
6322023-09-20T03:51:00.754ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6332023-09-20T03:51:00.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 76425187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38046 req_id = dca7c56e-b3a8-4eee-a083-84a9e047bd06 response_code = 204 uri = /services
6342023-09-20T03:51:00.828ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:970
6352023-09-20T03:51:00.831ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:521
6362023-09-20T03:51:00.831ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:523
6372023-09-20T03:51:00.864ZINFOSledAgent (RSS): rack_network_config: Some( RackNetworkConfig { infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, uplinks: [ UplinkConfig { gateway_ip: 10.151.1.100, switch: Switch0, uplink_cidr: Ipv4Network { addr: 10.151.1.174, prefix: 32, }, uplink_port: "qsfp0", uplink_port_fec: None, uplink_port_speed: Speed40G, uplink_vid: None, }, ], }, ) file = sled-agent/src/rack_setup/service.rs:604
6382023-09-20T03:51:00.865ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0cf2e290-a977-4efb-a951-606f600e35e9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:625
6392023-09-20T03:51:00.969ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0cf2e290-a977-4efb-a951-606f600e35e9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:625
6402023-09-20T03:51:01.068ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0cf2e290-a977-4efb-a951-606f600e35e9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:625
6412023-09-20T03:51:01.269ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0cf2e290-a977-4efb-a951-606f600e35e9/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:625
6422023-09-20T03:51:02.300ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b8526535-3e27-48e2-8f31-18f04c42ded7", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b8526535-3e27-48e2-8f31-18f04c42ded7" } file = sled-agent/src/rack_setup/service.rs:625
6432023-09-20T03:51:02.635ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a38bd9d1-190a-4b8a-8e8b-6a1640a77733", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a38bd9d1-190a-4b8a-8e8b-6a1640a77733" } file = sled-agent/src/rack_setup/service.rs:625
6442023-09-20T03:51:02.928ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "16bce009-ca07-4da3-92a4-073f18cae98a", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "16bce009-ca07-4da3-92a4-073f18cae98a" } file = sled-agent/src/rack_setup/service.rs:625
6452023-09-20T03:51:03.322ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "03b9eaa2-a50d-4080-b067-802e908334ff", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "03b9eaa2-a50d-4080-b067-802e908334ff" } file = sled-agent/src/rack_setup/service.rs:625
6462023-09-20T03:51:03.757ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "26c9762f-b7b6-47e4-b0c6-b89d9895ae9f", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "26c9762f-b7b6-47e4-b0c6-b89d9895ae9f" } file = sled-agent/src/rack_setup/service.rs:625
6472023-09-20T03:51:04.334ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c3423ba0-e9bd-4121-8adf-55ec636fd165", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c3423ba0-e9bd-4121-8adf-55ec636fd165" } file = sled-agent/src/rack_setup/service.rs:625
6482023-09-20T03:51:04.835ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "40e03724-4d47-4665-bdef-dbb1218e2428", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "40e03724-4d47-4665-bdef-dbb1218e2428" } file = sled-agent/src/rack_setup/service.rs:625
6492023-09-20T03:51:05.214ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7df72bf6-1ab3-4719-917f-80b72e4d7647", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7df72bf6-1ab3-4719-917f-80b72e4d7647" } file = sled-agent/src/rack_setup/service.rs:625
6502023-09-20T03:51:05.742ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6512023-09-20T03:51:06.165ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7fb0f033-b56b-4dc5-b23c-6f1b55379e92", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7fb0f033-b56b-4dc5-b23c-6f1b55379e92" } file = sled-agent/src/rack_setup/service.rs:625
6522023-09-20T03:51:07.428ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1ded1cf8-f263-4117-9be4-63d3428d51a4", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1ded1cf8-f263-4117-9be4-63d3428d51a4" } file = sled-agent/src/rack_setup/service.rs:625
6532023-09-20T03:51:08.180ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "88dc763f-06dd-4ad6-9b7a-11f5938e9ff2", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:07 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "88dc763f-06dd-4ad6-9b7a-11f5938e9ff2" } file = sled-agent/src/rack_setup/service.rs:625
6542023-09-20T03:51:08.940ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9fc2b10e-f1ce-41f1-b719-5ee9be40fd41", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:08 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9fc2b10e-f1ce-41f1-b719-5ee9be40fd41" } file = sled-agent/src/rack_setup/service.rs:625
6552023-09-20T03:51:09.842ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cce235ee-f156-417e-8560-97743c918dd2", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cce235ee-f156-417e-8560-97743c918dd2" } file = sled-agent/src/rack_setup/service.rs:625
6562023-09-20T03:51:10.729ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6572023-09-20T03:51:11.689ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e88ccee8-4593-459d-b5cd-d3115d7eaa9d", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e88ccee8-4593-459d-b5cd-d3115d7eaa9d" } file = sled-agent/src/rack_setup/service.rs:625
6582023-09-20T03:51:13.391ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dc47dcf3-f1bf-40ab-8495-372da5deca87", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dc47dcf3-f1bf-40ab-8495-372da5deca87" } file = sled-agent/src/rack_setup/service.rs:625
6592023-09-20T03:51:15.717ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6602023-09-20T03:51:15.783ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7d01ecc4-fb4a-4b47-81d4-c18652a6b16e", "content-length": "124", "date": "Wed, 20 Sep 2023 03:51:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7d01ecc4-fb4a-4b47-81d4-c18652a6b16e" } file = sled-agent/src/rack_setup/service.rs:625
6612023-09-20T03:51:17.381ZWARNSledAgent (StorageManager): failed to notify nexus about Add { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" }, variant: U2 } file = sled-agent/src/storage_manager.rs:957 total duration = 165.375054178s
6622023-09-20T03:51:17.514ZINFOSledAgent (SledAgentMain): contacting server nexus, registering sled baseboard = Baseboard { part_number: "i86pc", revision: 0, serial_number: "fdfb434afafc46a0bcfaaebdbcc5d8ec" } file = sled-agent/src/sled_agent.rs:526 id = 964838d7-ad13-4f5c-8503-dad6ebc26cf6
6632023-09-20T03:51:17.517ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxp_f4b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-f4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 165.50914183s
6642023-09-20T03:51:17.593ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxp_616b26df-e62a-4c68-b506-f4a923d8aaf7 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-616b26df-e62a-4c68-b506-f4a923d8aaf7", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 165.585950639s
6652023-09-20T03:51:17.604ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxp_31bd71cd-4736-4a12-a387-9b74b050396f on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-31bd71cd-4736-4a12-a387-9b74b050396f", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 165.597462775s
6662023-09-20T03:51:17.638ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 165.632328868s
6672023-09-20T03:51:17.643ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxp_14b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-14b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 165.636135489s
6682023-09-20T03:51:17.658ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxi_b462a7f7-b628-40fe-80ff-4e4189e2d62b on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-b462a7f7-b628-40fe-80ff-4e4189e2d62b", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 165.651428165s
6692023-09-20T03:51:17.703ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxp_e4b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-e4b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 165.695893069s
6702023-09-20T03:51:20.530ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b2df2e0d-7fe5-44be-bd32-57e5ac36fd16", "content-length": "174", "date": "Wed, 20 Sep 2023 03:51:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"31bd71cd-4736-4a12-a387-9b74b050396f\"", request_id: "b2df2e0d-7fe5-44be-bd32-57e5ac36fd16" } file = sled-agent/src/rack_setup/service.rs:625
6712023-09-20T03:51:20.705ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6722023-09-20T03:51:24.268ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c1373925-2ff0-4e65-8ee5-9b93709a8384", "content-length": "174", "date": "Wed, 20 Sep 2023 03:51:23 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"24b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "c1373925-2ff0-4e65-8ee5-9b93709a8384" } file = sled-agent/src/rack_setup/service.rs:625
6732023-09-20T03:51:24.306ZWARNSledAgent (StorageManager): failed to notify nexus about a new pool oxp_24b4dc87-ab46-49fb-a4b4-d361ae214c03 on disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-24b4dc87-ab46-49fb-a4b4-d361ae214c03", model: "synthetic-model" } file = sled-agent/src/storage_manager.rs:494 total duration = 172.318375204s
6742023-09-20T03:51:24.679ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64142
6752023-09-20T03:51:24.679ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64142 req_id = 7e717c9c-42fb-4333-9dff-14dd8fc7c80d response_code = 200 uri = /baseboard
6762023-09-20T03:51:25.692ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6772023-09-20T03:51:28.630ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cc405d79-44f6-4a08-998b-0b18d5b344d7", "content-length": "174", "date": "Wed, 20 Sep 2023 03:51:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: zpool with id \"24b4dc87-ab46-49fb-a4b4-d361ae214c03\"", request_id: "cc405d79-44f6-4a08-998b-0b18d5b344d7" } file = sled-agent/src/rack_setup/service.rs:625
6782023-09-20T03:51:30.680ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6792023-09-20T03:51:34.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44565
6802023-09-20T03:51:34.430ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:392 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8838b9ad-45a0-4080-b0f1-423b9685a5f9, kind: Service { id: 3982ba39-4a3c-46be-b1d4-f0505bc72832 }, name: Name("external-dns-3982ba39-4a3c-46be-b1d4-f0505bc72832"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 251])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d312aa34-798e-49f0-b8f7-059dd74f3904, kind: Service { id: f840ab86-b51b-4dfc-87f5-1e94da606b2f }, name: Name("external-dns-f840ab86-b51b-4dfc-87f5-1e94da606b2f"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 195])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7f19b2c5-ab60-4929-9e6a-01f96699cb00, kind: Service { id: 8e413664-c870-4e1d-9bd8-441f1c8249bc }, name: Name("nexus-8e413664-c870-4e1d-9bd8-441f1c8249bc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 32])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 827e197c-8d97-41cd-9226-3b4c742270bd, kind: Service { id: b023678b-9619-4790-b197-c706bb2ff170 }, name: Name("nexus-b023678b-9619-4790-b197-c706bb2ff170"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: c384af75-38b2-451e-ba52-5a5615fce723, kind: Service { id: b2e743e1-ac6b-4306-a859-2ab1114b836a }, name: Name("nexus-b2e743e1-ac6b-4306-a859-2ab1114b836a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 250])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
6812023-09-20T03:51:34.430ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:411 port = "opte0" rules = []
6822023-09-20T03:51:34.430ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:411 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
6832023-09-20T03:51:34.430ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:411 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
6842023-09-20T03:51:34.430ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:411 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
6852023-09-20T03:51:34.430ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:411 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
6862023-09-20T03:51:34.430ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:411 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
6872023-09-20T03:51:34.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 422 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44565 req_id = b66d17a2-d4c6-4d1c-bac6-5fc89c360565 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
6882023-09-20T03:51:34.564ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:635
6892023-09-20T03:51:35.668ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6902023-09-20T03:51:40.655ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6912023-09-20T03:51:45.643ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
6922023-09-20T03:51:46.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36954
6932023-09-20T03:51:46.616ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:174 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23 propolis_id = 5c78d040-543b-47cd-a7d6-ff7452556239
6942023-09-20T03:51:46.616ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:204 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
6952023-09-20T03:51:46.616ZINFOSledAgent (InstanceManager): Instance::new w/initial HW: InstanceHardware { runtime: InstanceRuntimeState { run_state: Creating, sled_id: 964838d7-ad13-4f5c-8503-dad6ebc26cf6, propolis_id: 5c78d040-543b-47cd-a7d6-ff7452556239, dst_propolis_id: None, propolis_addr: Some([fd00:1122:3344:101::22]:12400), migration_id: None, propolis_gen: Generation(1), ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: "localshark", gen: Generation(1), time_updated: 2023-09-20T03:51:45.697153Z }, nics: [NetworkInterface { id: 276eae38-9f78-4f8a-a76c-f2bed06f0afa, kind: Instance { id: 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 17, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15786826), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, external_ips: [10.151.1.176], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 276eae38-9f78-4f8a-a76c-f2bed06f0afa, kind: Instance { id: 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 17, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15786826), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 276eae38-9f78-4f8a-a76c-f2bed06f0afa, kind: Instance { id: 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 17, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15786826), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(15786826))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 276eae38-9f78-4f8a-a76c-f2bed06f0afa, kind: Instance { id: 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 17, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15786826), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], disks: [DiskRequest { name: "disk-be0f82f5a9b", slot: Slot(1), read_only: false, device: "nvme", volume_construction_request: Volume { id: 3761cb4a-547c-46e1-974f-4f9553b4ba72, block_size: 512, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, opts: CrucibleOpts { id: 3761cb4a-547c-46e1-974f-4f9553b4ba72, target: [[fd00:1122:3344:101::12]:19000, [fd00:1122:3344:101::17]:19000, [fd00:1122:3344:101::16]:19000], lossy: false, flush_timeout: None, key: Some("DJ4K3V7E6qa2BWDW/oaHrKdwDAVkkhIyAv8k8H1MMOs="), cert_pem: None, key_pem: None, root_cert_pem: None, control: None, read_only: false }, gen: 1 }], read_only_parent: Some(Url { id: fc3ab372-64c9-4b9a-9b93-2ac607cbe983, block_size: 512, url: "http://[fd00:1122:3344:101::1]:54321/debian-11-genericcloud-amd64.raw" }) } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAA6dx40VzRXAAB3HjRXAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAOnceNFc0VwAAdx40VwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI4NmM5YjBhNy1iNmM4LTRmZDItOTExMi1jNWJkY2ZlYWFkMjMiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTTJqbkpLcjJXa0NjTjZJK0pyWGFsOWEvVnNlNTR5OTQ2R3N0Snl5cUMyYyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } file = sled-agent/src/instance.rs:628
6962023-09-20T03:51:46.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 984 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36954 req_id = 949cdae3-8945-437a-a3cf-fbcec8633d2d response_code = 200 uri = /instances/86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
6972023-09-20T03:51:46.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34600
6982023-09-20T03:51:46.684ZINFOSledAgent (InstanceManager): Ensuring new instance file = sled-agent/src/instance.rs:725 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
6992023-09-20T03:51:46.684ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:275 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23 state = InstanceRuntimeState { run_state: Starting, sled_id: 964838d7-ad13-4f5c-8503-dad6ebc26cf6, propolis_id: 5c78d040-543b-47cd-a7d6-ff7452556239, dst_propolis_id: None, propolis_addr: Some([fd00:1122:3344:101::22]:12400), migration_id: None, propolis_gen: Generation(1), ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: "localshark", gen: Generation(2), time_updated: 2023-09-20T03:51:46.684653108Z }
7002023-09-20T03:51:46.751ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:376 port = Port { inner: PortInner { name: "opte6", _ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 249, 17, 182]), slot: 0, vni: Vni { inner: 15786826 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
7012023-09-20T03:51:46.785ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239 file = illumos-utils/src/zone.rs:314 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7022023-09-20T03:51:46.805ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239 file = illumos-utils/src/zone.rs:353 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7032023-09-20T03:51:48.298ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::22"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::c]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7042023-09-20T03:51:48.298ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:506 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23 zone = oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239
7052023-09-20T03:51:50.632ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7062023-09-20T03:51:53.187ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239 file = sled-agent/src/instance.rs:970 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7072023-09-20T03:51:54.134ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:979 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7082023-09-20T03:51:54.169ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:996 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7092023-09-20T03:51:54.170ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAA6dx40VzRXAAB3HjRXAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAOnceNFc0VwAAdx40VwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI4NmM5YjBhNy1iNmM4LTRmZDItOTExMi1jNWJkY2ZlYWFkMjMiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTTJqbkpLcjJXa0NjTjZJK0pyWGFsOWEvVnNlNTR5OTQ2R3N0Snl5cUMyYyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-be0f82f5a9b", read_only: false, slot: Slot(1), volume_construction_request: Volume { block_size: 512, id: 3761cb4a-547c-46e1-974f-4f9553b4ba72, read_only_parent: Some(Url { block_size: 512, id: fc3ab372-64c9-4b9a-9b93-2ac607cbe983, url: "http://[fd00:1122:3344:101::1]:54321/debian-11-genericcloud-amd64.raw" }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3761cb4a-547c-46e1-974f-4f9553b4ba72, key: Some("DJ4K3V7E6qa2BWDW/oaHrKdwDAVkkhIyAv8k8H1MMOs="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19000", "[fd00:1122:3344:101::17]:19000", "[fd00:1122:3344:101::16]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:462 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7102023-09-20T03:51:54.632ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55417
7112023-09-20T03:51:54.633ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 945 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55417 req_id = 89652d54-19da-432f-8b92-255d62521f67 response_code = 200 uri = /baseboard
7122023-09-20T03:51:54.640ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:464 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7132023-09-20T03:51:54.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 7977313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34600 req_id = fc4105c0-2d32-4cf9-be9c-df14ed4c848d response_code = 200 uri = /instances/86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23/state
7142023-09-20T03:51:54.640ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { instance_state: Starting, migration_status: NoMigration } file = sled-agent/src/instance.rs:344 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7152023-09-20T03:51:54.640ZINFOSledAgent (InstanceManager): New state: Starting, action: None file = sled-agent/src/instance.rs:366 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7162023-09-20T03:51:54.640ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:275 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23 state = InstanceRuntimeState { run_state: Starting, sled_id: 964838d7-ad13-4f5c-8503-dad6ebc26cf6, propolis_id: 5c78d040-543b-47cd-a7d6-ff7452556239, dst_propolis_id: None, propolis_addr: Some([fd00:1122:3344:101::22]:12400), migration_id: None, propolis_gen: Generation(1), ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: "localshark", gen: Generation(3), time_updated: 2023-09-20T03:51:54.640444124Z }
7172023-09-20T03:51:54.685ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { instance_state: Running, migration_status: NoMigration } file = sled-agent/src/instance.rs:344 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7182023-09-20T03:51:54.685ZINFOSledAgent (InstanceManager): New state: Running, action: None file = sled-agent/src/instance.rs:366 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7192023-09-20T03:51:54.685ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:275 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23 state = InstanceRuntimeState { run_state: Running, sled_id: 964838d7-ad13-4f5c-8503-dad6ebc26cf6, propolis_id: 5c78d040-543b-47cd-a7d6-ff7452556239, dst_propolis_id: None, propolis_addr: Some([fd00:1122:3344:101::22]:12400), migration_id: None, propolis_gen: Generation(1), ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: "localshark", gen: Generation(4), time_updated: 2023-09-20T03:51:54.685126383Z }
7202023-09-20T03:51:55.620ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7212023-09-20T03:52:00.608ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7222023-09-20T03:52:05.597ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7232023-09-20T03:52:10.589ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7242023-09-20T03:52:15.592ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7252023-09-20T03:52:20.593ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7262023-09-20T03:52:24.627ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42610
7272023-09-20T03:52:24.627ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42610 req_id = 7a652ebe-d3e3-4c36-bd5d-ecca6d003e2d response_code = 200 uri = /baseboard
7282023-09-20T03:52:25.594ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7292023-09-20T03:52:30.596ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7302023-09-20T03:52:35.598ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7312023-09-20T03:52:40.599ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7322023-09-20T03:52:45.601ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7332023-09-20T03:52:50.602ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7342023-09-20T03:52:54.662ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52386
7352023-09-20T03:52:54.662ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52386 req_id = 82f60be9-0598-4fa4-a6e5-e70fb125ff70 response_code = 200 uri = /baseboard
7362023-09-20T03:52:55.603ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7372023-09-20T03:53:00.604ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7382023-09-20T03:53:05.606ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7392023-09-20T03:53:10.606ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7402023-09-20T03:53:15.608ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7412023-09-20T03:53:20.610ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7422023-09-20T03:53:24.697ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41515
7432023-09-20T03:53:24.698ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 632 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41515 req_id = 8117beec-3630-4009-bd14-7902822817b3 response_code = 200 uri = /baseboard
7442023-09-20T03:53:25.611ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7452023-09-20T03:53:30.613ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7462023-09-20T03:53:35.614ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7472023-09-20T03:53:40.616ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7482023-09-20T03:53:45.618ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7492023-09-20T03:53:50.619ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7502023-09-20T03:53:54.733ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61799
7512023-09-20T03:53:54.733ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61799 req_id = f2286fd6-c0fb-423b-ba1b-2866d3b094c4 response_code = 200 uri = /baseboard
7522023-09-20T03:53:55.621ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7532023-09-20T03:54:00.623ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7542023-09-20T03:54:05.625ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7552023-09-20T03:54:10.626ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7562023-09-20T03:54:15.627ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7572023-09-20T03:54:20.628ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7582023-09-20T03:54:24.767ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44904
7592023-09-20T03:54:24.767ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44904 req_id = b75c24bf-c7d7-4661-a7bf-64a92788e18c response_code = 200 uri = /baseboard
7602023-09-20T03:54:25.558ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/storage/dump_setup.rs:530
7612023-09-20T03:54:25.630ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7622023-09-20T03:54:30.631ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7632023-09-20T03:54:35.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:769 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59962
7642023-09-20T03:54:35.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/99cea06/dropshot/src/server.rs:853 latency_us = 585 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59962 req_id = a4fa6e75-5ff5-42c8-bab3-b12a780ceb43 response_code = 200 uri = /instances/86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23/state
7652023-09-20T03:54:35.404ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { instance_state: Stopping, migration_status: NoMigration } file = sled-agent/src/instance.rs:344 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7662023-09-20T03:54:35.404ZINFOSledAgent (InstanceManager): New state: Stopping, action: None file = sled-agent/src/instance.rs:366 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7672023-09-20T03:54:35.404ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:275 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23 state = InstanceRuntimeState { run_state: Stopping, sled_id: 964838d7-ad13-4f5c-8503-dad6ebc26cf6, propolis_id: 5c78d040-543b-47cd-a7d6-ff7452556239, dst_propolis_id: None, propolis_addr: Some([fd00:1122:3344:101::22]:12400), migration_id: None, propolis_gen: Generation(1), ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: "localshark", gen: Generation(6), time_updated: 2023-09-20T03:54:35.404612118Z }
7682023-09-20T03:54:35.598ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { instance_state: Destroyed, migration_status: NoMigration } file = sled-agent/src/instance.rs:344 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7692023-09-20T03:54:35.598ZINFOSledAgent (InstanceManager): New state: Stopped, action: Some(Destroy) file = sled-agent/src/instance.rs:366 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7702023-09-20T03:54:35.598ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:275 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23 state = InstanceRuntimeState { run_state: Stopped, sled_id: 964838d7-ad13-4f5c-8503-dad6ebc26cf6, propolis_id: 5c78d040-543b-47cd-a7d6-ff7452556239, dst_propolis_id: None, propolis_addr: Some([fd00:1122:3344:101::22]:12400), migration_id: None, propolis_gen: Generation(2), ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: "localshark", gen: Generation(7), time_updated: 2023-09-20T03:54:35.598895877Z }
7712023-09-20T03:54:35.632ZINFOSledAgent (BootstrapAgentStartup): Received prefixes from ddmd DdmAdminClient = [::1]:8000 file = ddm-admin-client/src/lib.rs:119 prefixes = {"fe80::7889:8ff:fe14:e849": [PathVector { destination: Ipv6Prefix { addr: fd00:99::, len: 64 }, path: ["oxz_switch"] }]}
7722023-09-20T03:54:35.715ZINFOSledAgent (InstanceManager): Taking action: Destroy file = sled-agent/src/instance.rs:508 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7732023-09-20T03:54:35.715ZINFOSledAgent (InstanceManager): take_action: Taking the Destroy action file = sled-agent/src/instance.rs:523 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7742023-09-20T03:54:35.716ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/a462a7f7-b628-40fe-80ff-4e4189e2d62b/debug/bundle/zone", "/pool/int/b462a7f7-b628-40fe-80ff-4e4189e2d62b/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/e4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug/oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239", "/pool/ext/d462a7f7-b628-40fe-80ff-4e4189e2d62b/crypt/debug/oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239", "/pool/ext/cd70d7f6-2354-4bf2-8012-55bf9eaf7930/crypt/debug/oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239", "/pool/ext/f4b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug/oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239", "/pool/ext/ceb4461c-cf56-4719-ad3c-14430bfdfb60/crypt/debug/oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239", "/pool/ext/616b26df-e62a-4c68-b506-f4a923d8aaf7/crypt/debug/oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239", "/pool/ext/24b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug/oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239", "/pool/ext/31bd71cd-4736-4a12-a387-9b74b050396f/crypt/debug/oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239", "/pool/ext/14b4dc87-ab46-49fb-a4b4-d361ae214c03/crypt/debug/oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239"] } file = sled-agent/src/zone_bundle.rs:364 zone_name = oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239
7752023-09-20T03:54:36.309ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:851 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239", bundle_id: c2016724-f7c8-408a-b1e5-90dd4adc4b57 }, time_created: 2023-09-20T03:54:35.716203264Z, version: 0, cause: TerminatedInstance }
7762023-09-20T03:54:36.309ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_5c78d040-543b-47cd-a7d6-ff7452556239 file = sled-agent/src/instance.rs:575 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7772023-09-20T03:54:37.934ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:268 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23
7782023-09-20T03:54:37.971ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:494 instance_id = 86c9b0a7-b6c8-4fd2-9112-c5bdcfeaad23