Max level shown:
1 [ Dec 21 05:41:14 Enabled. ]
2 [ Dec 21 05:41:14 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 21 05:41:14 Method "start" exited with status 0. ]
4 [ Dec 21 05:41:14 Rereading configuration. ]
5 [ Dec 21 05:41:14 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-21T05:41:14.982ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-21T05:41:14.982ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-21T05:41:15.034ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-21T05:41:15.034ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-21T05:41:15.149ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-21T05:41:15.158ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-21T05:41:15.167ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-21T05:41:15.772ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-21T05:41:15.914ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-21T05:41:15.914ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-21T05:41:15.914ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-21T05:41:15.914ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-21T05:41:15.914ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-12-21T05:41:15.914ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-12-21T05:41:15.917ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-21T05:41:15.917ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-21T05:41:15.917ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-21T05:41:15.917ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-21T05:41:15.917ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-21T05:41:15.917ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-21T05:41:15.917ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-21T05:41:15.917ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-21T05:41:15.917ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-21T05:41:15.929ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-21T05:41:15.929ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool)
322024-12-21T05:41:16.032ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool), kind: Internal }
332024-12-21T05:41:16.406ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-21T05:41:16.406ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-21T05:41:16.406ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-21T05:41:16.406ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-21T05:41:16.406ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382024-12-21T05:41:16.406ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-21T05:41:16.406ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-21T05:41:16.415ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-21T05:41:16.415ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool)
422024-12-21T05:41:16.504ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool), kind: Internal }
432024-12-21T05:41:16.872ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-21T05:41:16.872ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-21T05:41:16.872ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482024-12-21T05:41:16.872ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-21T05:41:16.872ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-21T05:41:16.872ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-21T05:41:16.872ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
522024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-12-21T05:41:16.872ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-21T05:41:16.872ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-21T05:41:16.872ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
572024-12-21T05:41:16.872ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-12-21T05:41:16.872ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-21T05:41:16.872ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-21T05:41:16.872ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-21T05:41:16.872ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
642024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
652024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
662024-12-21T05:41:16.872ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-12-21T05:41:16.872ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-21T05:41:16.872ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-21T05:41:16.872ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722024-12-21T05:41:16.872ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-21T05:41:16.872ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-21T05:41:16.872ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-21T05:41:16.872ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782024-12-21T05:41:16.872ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-21T05:41:16.872ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-21T05:41:16.872ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812024-12-21T05:41:16.872ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-12-21T05:41:16.872ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-12-21T05:41:16.872ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
842024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862024-12-21T05:41:16.872ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872024-12-21T05:41:16.872ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-21T05:41:16.872ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892024-12-21T05:41:16.872ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
902024-12-21T05:41:16.872ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
912024-12-21T05:41:16.872ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
922024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-12-21T05:41:16.872ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-12-21T05:41:16.872ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952024-12-21T05:41:16.872ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
962024-12-21T05:41:16.872ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972024-12-21T05:41:16.873ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
982024-12-21T05:41:16.873ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
992024-12-21T05:41:16.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1002024-12-21T05:41:16.873ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1012024-12-21T05:41:16.873ZINFOSledAgent (bootstore): No ledger in /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1022024-12-21T05:41:16.873ZINFOSledAgent (bootstore): No ledger in /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1032024-12-21T05:41:16.873ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1042024-12-21T05:41:16.873ZINFOSledAgent (bootstore): No ledger in /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-21T05:41:16.873ZINFOSledAgent (bootstore): No ledger in /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-21T05:41:16.873ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1072024-12-21T05:41:16.873ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1082024-12-21T05:41:16.873ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1092024-12-21T05:41:16.884ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1102024-12-21T05:41:16.884ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1222, tv_nsec: 140352093 } time_to_next_cleanup = 599.999922048s
1112024-12-21T05:41:16.884ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1122024-12-21T05:41:16.884ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1132024-12-21T05:41:16.884ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/sled-agent-request.json file = common/src/ledger.rs:188
1142024-12-21T05:41:16.887ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/sled-agent-request.json file = common/src/ledger.rs:188
1152024-12-21T05:41:16.887ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1162024-12-21T05:41:16.889ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1172024-12-21T05:41:16.889ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1182024-12-21T05:41:16.889ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1192024-12-21T05:41:16.889ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1202024-12-21T05:41:16.889ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1212024-12-21T05:41:16.889ZINFOSledAgent (RSS): No ledger in /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/rss-started.marker file = common/src/ledger.rs:188
1222024-12-21T05:41:16.889ZINFOSledAgent (RSS): No ledger in /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/rss-started.marker file = common/src/ledger.rs:188
1232024-12-21T05:41:16.889ZINFOSledAgent (RSS): No ledger in /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-12-21T05:41:16.889ZINFOSledAgent (RSS): No ledger in /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-12-21T05:41:16.889ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1262024-12-21T05:41:16.889ZINFOSledAgent (RSS): Writing ledger to /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1272024-12-21T05:41:16.890ZINFOSledAgent (RSS): Writing ledger to /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1282024-12-21T05:41:16.890ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1292024-12-21T05:41:16.890ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1302024-12-21T05:41:16.890ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1312024-12-21T05:41:16.890ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1322024-12-21T05:41:16.890ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1332024-12-21T05:41:16.890ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1342024-12-21T05:41:16.890ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1352024-12-21T05:41:16.890ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1362024-12-21T05:41:16.890ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 67885466-b1c6-48f5-a800-f848c80749b6 (sled), rack_id: 9691c7fa-48ff-41f7-95ba-39aeacfa3c56, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1372024-12-21T05:41:16.891ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1382024-12-21T05:41:16.891ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1392024-12-21T05:41:16.896ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1402024-12-21T05:41:16.902ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1412024-12-21T05:41:16.902ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1422024-12-21T05:41:16.906ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1432024-12-21T05:41:16.906ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1442024-12-21T05:41:16.906ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:62655
1452024-12-21T05:41:16.907ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 67885466-b1c6-48f5-a800-f848c80749b6 (sled), rack_id: 9691c7fa-48ff-41f7-95ba-39aeacfa3c56, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1462024-12-21T05:41:16.907ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1472024-12-21T05:41:16.907ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1482024-12-21T05:41:16.907ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1492024-12-21T05:41:16.907ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1502024-12-21T05:41:16.907ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1512024-12-21T05:41:16.907ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1522024-12-21T05:41:16.909ZINFOSledAgent (StorageManager): No ledger in /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1532024-12-21T05:41:16.909ZINFOSledAgent (StorageManager): No ledger in /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1542024-12-21T05:41:16.909ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1552024-12-21T05:41:16.909ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1562024-12-21T05:41:16.909ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1572024-12-21T05:41:16.910ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1582024-12-21T05:41:16.910ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1592024-12-21T05:41:16.923ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1602024-12-21T05:41:16.944ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1612024-12-21T05:41:16.962ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1622024-12-21T05:41:16.970ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
1632024-12-21T05:41:16.970ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1642024-12-21T05:41:16.970ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
1652024-12-21T05:41:16.970ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1662024-12-21T05:41:16.973ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 83.209608ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "85ebd454-e6df-4e37-874f-7b463e458c9d", "content-length": "124", "date": "Sat, 21 Dec 2024 05:41:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "85ebd454-e6df-4e37-874f-7b463e458c9d" } file = clients/ddm-admin-client/src/lib.rs:177
1672024-12-21T05:41:16.984ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_c2c552a1-f416-4f8c-90e9-2c18efd74095/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1682024-12-21T05:41:17.009ZINFOSledAgent: successfully created encrypted zvol: name="oxi_c2c552a1-f416-4f8c-90e9-2c18efd74095/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1692024-12-21T05:41:17.009ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_c2c552a1-f416-4f8c-90e9-2c18efd74095/swap" file = sled-agent/src/swap_device.rs:96
1702024-12-21T05:41:17.014ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
1712024-12-21T05:41:17.014ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1722024-12-21T05:41:17.014ZINFOSledAgent (BackingFs): Ensuring dataset oxi_c2c552a1-f416-4f8c-90e9-2c18efd74095/backing/fmd file = sled-agent/src/backing_fs.rs:139
1732024-12-21T05:41:17.058ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1742024-12-21T05:41:17.058ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 96.277461ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d948ae44-d30d-4599-94b9-c1d75732012b", "content-length": "124", "date": "Sat, 21 Dec 2024 05:41:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d948ae44-d30d-4599-94b9-c1d75732012b" } file = clients/ddm-admin-client/src/lib.rs:177
1752024-12-21T05:41:17.082ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1762024-12-21T05:41:17.155ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-21T05:41:17.156ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 143.386717ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c30ce0b6-4f3b-4eaa-aa65-2de909e345ac", "content-length": "124", "date": "Sat, 21 Dec 2024 05:41:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c30ce0b6-4f3b-4eaa-aa65-2de909e345ac" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-21T05:41:17.301ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-12-21T05:41:17.301ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 218.719806ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b042a107-cc90-4ac5-8b3e-b3f4348f392d", "content-length": "124", "date": "Sat, 21 Dec 2024 05:41:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b042a107-cc90-4ac5-8b3e-b3f4348f392d" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-12-21T05:41:17.302ZINFOSledAgent (BackingFs): Mounting oxi_c2c552a1-f416-4f8c-90e9-2c18efd74095/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1812024-12-21T05:41:17.315ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1822024-12-21T05:41:17.315ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1832024-12-21T05:41:17.315ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1842024-12-21T05:41:17.315ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1852024-12-21T05:41:17.522ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-12-21T05:41:17.522ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 184.914402ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8ccc307e-f010-48bf-bab8-a930bea9913a", "content-length": "124", "date": "Sat, 21 Dec 2024 05:41:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8ccc307e-f010-48bf-bab8-a930bea9913a" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-12-21T05:41:17.708ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-12-21T05:41:17.709ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 162.112949ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "95d1b073-b1c4-489d-9729-3165ca590873", "content-length": "124", "date": "Sat, 21 Dec 2024 05:41:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "95d1b073-b1c4-489d-9729-3165ca590873" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-12-21T05:41:17.872ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1902024-12-21T05:41:17.873ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 207.504495ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dc9be611-90dc-42e0-9125-18e74c2e29eb", "content-length": "124", "date": "Sat, 21 Dec 2024 05:41:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dc9be611-90dc-42e0-9125-18e74c2e29eb" } file = clients/ddm-admin-client/src/lib.rs:177
1912024-12-21T05:41:18.053ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
1922024-12-21T05:41:18.059ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:35623 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
1932024-12-21T05:41:18.059ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
1942024-12-21T05:41:18.059ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:35623 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 67885466-b1c6-48f5-a800-f848c80749b6 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
1952024-12-21T05:41:18.060ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 230.79462ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
1962024-12-21T05:41:18.062ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
1972024-12-21T05:41:18.062ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
1982024-12-21T05:41:18.062ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
1992024-12-21T05:41:18.062ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2002024-12-21T05:41:18.081ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2012024-12-21T05:41:18.293ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 266.568105ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2022024-12-21T05:41:18.561ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.476074045s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2032024-12-21T05:41:20.042ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.792924048s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2042024-12-21T05:41:20.647ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2052024-12-21T05:41:20.647ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2062024-12-21T05:41:20.647ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2072024-12-21T05:41:20.647ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2082024-12-21T05:41:20.647ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2092024-12-21T05:41:20.647ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2102024-12-21T05:41:20.649ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2112024-12-21T05:41:20.651ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2122024-12-21T05:41:20.651ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='af56e51e-4fe7-4ac4-86dc-fae2bb3bf271'/> <propval type="astring" name="rack_id" value='9691c7fa-48ff-41f7-95ba-39aeacfa3c56'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fec6:2f9'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='9691c7fa-48ff-41f7-95ba-39aeacfa3c56'/> <propval type="astring" name="sled_id" value='67885466-b1c6-48f5-a800-f848c80749b6'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='67885466-b1c6-48f5-a800-f848c80749b6'/> <propval type="astring" name="rack_uuid" value='9691c7fa-48ff-41f7-95ba-39aeacfa3c56'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='67885466-b1c6-48f5-a800-f848c80749b6'/> <propval type="astring" name="rack_uuid" value='9691c7fa-48ff-41f7-95ba-39aeacfa3c56'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2132024-12-21T05:41:20.651ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2142024-12-21T05:41:20.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 28.87927ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2152024-12-21T05:41:21.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 67.137531ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-21T05:41:21.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 138.384414ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-12-21T05:41:21.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 429.10856ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-21T05:41:21.836ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.753957438s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2192024-12-21T05:41:22.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 638.944864ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-21T05:41:22.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 825.918356ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-21T05:41:23.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.084155032s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-21T05:41:24.593ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.200726574s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2232024-12-21T05:41:25.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.022537394s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-21T05:41:26.417ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/67885466-b1c6-48f5-a800-f848c80749b6) file = sled-agent/src/nexus.rs:527 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2252024-12-21T05:41:26.447ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2262024-12-21T05:41:26.450ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2272024-12-21T05:41:26.450ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2282024-12-21T05:41:26.450ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2292024-12-21T05:41:26.450ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2302024-12-21T05:41:26.450ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2312024-12-21T05:41:26.450ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322024-12-21T05:41:26.450ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2332024-12-21T05:41:26.451ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2342024-12-21T05:41:26.451ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2352024-12-21T05:41:26.649ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:62655
2362024-12-21T05:41:26.649ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2372024-12-21T05:41:26.649ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2382024-12-21T05:41:26.655ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2392024-12-21T05:41:26.655ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2402024-12-21T05:41:26.655ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2412024-12-21T05:41:26.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35126
2422024-12-21T05:41:26.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2432024-12-21T05:41:26.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2442024-12-21T05:41:26.888ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-zones.json file = common/src/ledger.rs:188
2452024-12-21T05:41:26.888ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-zones.json file = common/src/ledger.rs:188
2462024-12-21T05:41:26.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 407 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35126 req_id = 7403a7a1-9297-43b3-b918-d57b4250932e response_code = 200 uri = /inventory
2472024-12-21T05:41:26.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44860
2482024-12-21T05:41:26.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44860 req_id = dea25f8c-e2d3-4533-8ab2-2b88d4b1005c response_code = 200 uri = /sled-role
2492024-12-21T05:41:26.952ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 8a10636f-8c15-4c98-9079-8cb15f52c0cd (physical_disk), pool_id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 583163cf-30c0-442c-b1d6-1d9f2d5bd417 (physical_disk), pool_id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 992bd231-0a8d-45ec-a345-4e97b6901bda (physical_disk), pool_id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 5b4b081a-d4e9-4f75-8107-54820e451a29 (physical_disk), pool_id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 559a63a9-5410-41c6-b58f-ce6cb408ffd4 (physical_disk), pool_id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ef9ecf43-8575-4212-87da-d11761cf161f (physical_disk), pool_id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: d2741e27-f400-46d6-a90f-8d7386b404fd (physical_disk), pool_id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 817676e6-39b3-44f0-9f55-946cc504d45b (physical_disk), pool_id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 059dab88-25c7-487e-814e-046ce24a47f2 (physical_disk), pool_id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2502024-12-21T05:41:26.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42923
2512024-12-21T05:41:26.952ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2522024-12-21T05:41:26.952ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 8a10636f-8c15-4c98-9079-8cb15f52c0cd (physical_disk), pool_id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 583163cf-30c0-442c-b1d6-1d9f2d5bd417 (physical_disk), pool_id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 992bd231-0a8d-45ec-a345-4e97b6901bda (physical_disk), pool_id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 5b4b081a-d4e9-4f75-8107-54820e451a29 (physical_disk), pool_id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 559a63a9-5410-41c6-b58f-ce6cb408ffd4 (physical_disk), pool_id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: ef9ecf43-8575-4212-87da-d11761cf161f (physical_disk), pool_id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: d2741e27-f400-46d6-a90f-8d7386b404fd (physical_disk), pool_id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 817676e6-39b3-44f0-9f55-946cc504d45b (physical_disk), pool_id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 059dab88-25c7-487e-814e-046ce24a47f2 (physical_disk), pool_id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2532024-12-21T05:41:26.952ZINFOSledAgent (StorageManager): No ledger in /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2542024-12-21T05:41:26.952ZINFOSledAgent (StorageManager): No ledger in /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552024-12-21T05:41:26.953ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2562024-12-21T05:41:26.953ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2572024-12-21T05:41:26.953ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2582024-12-21T05:41:26.953ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2592024-12-21T05:41:26.953ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2602024-12-21T05:41:27.107ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2612024-12-21T05:41:27.107ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool)
2622024-12-21T05:41:27.555ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/67885466-b1c6-48f5-a800-f848c80749b6) file = sled-agent/src/probe_manager.rs:231 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2632024-12-21T05:41:28.191ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2642024-12-21T05:41:28.192ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2809702307794696978 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2652024-12-21T05:41:28.192ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12099399048174492875 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2662024-12-21T05:41:28.203ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }
2672024-12-21T05:41:28.212ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2682024-12-21T05:41:28.212ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2692024-12-21T05:41:28.213ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2702024-12-21T05:41:28.213ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2712024-12-21T05:41:28.213ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722024-12-21T05:41:28.213ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732024-12-21T05:41:28.213ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2742024-12-21T05:41:28.251ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2752024-12-21T05:41:28.261ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone file = sled-storage/src/dataset.rs:302
2762024-12-21T05:41:28.407ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7912c084-27e1-426d-a3ef-7d0f642d9382 file = sled-storage/src/dataset.rs:388
2772024-12-21T05:41:28.415ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2782024-12-21T05:41:28.415ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2792024-12-21T05:41:28.415ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2802024-12-21T05:41:28.415ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2812024-12-21T05:41:28.415ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2822024-12-21T05:41:28.425ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2832024-12-21T05:41:28.425ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool)
2842024-12-21T05:41:28.518ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }
2852024-12-21T05:41:28.528ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2862024-12-21T05:41:28.528ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2872024-12-21T05:41:28.528ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2882024-12-21T05:41:28.528ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2892024-12-21T05:41:28.528ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2902024-12-21T05:41:28.528ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912024-12-21T05:41:28.528ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2922024-12-21T05:41:28.559ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/67885466-b1c6-48f5-a800-f848c80749b6) file = sled-agent/src/probe_manager.rs:231 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
2932024-12-21T05:41:28.561ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942024-12-21T05:41:28.569ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crypt/zone file = sled-storage/src/dataset.rs:302
2952024-12-21T05:41:28.719ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3351d590-858e-45b6-91ff-51f0d9e17995 file = sled-storage/src/dataset.rs:388
2962024-12-21T05:41:28.726ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972024-12-21T05:41:28.727ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982024-12-21T05:41:28.727ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992024-12-21T05:41:28.727ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002024-12-21T05:41:28.727ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012024-12-21T05:41:28.736ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022024-12-21T05:41:28.737ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool)
3032024-12-21T05:41:28.833ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }
3042024-12-21T05:41:28.841ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3052024-12-21T05:41:28.841ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3062024-12-21T05:41:28.841ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3072024-12-21T05:41:28.841ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3082024-12-21T05:41:28.841ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092024-12-21T05:41:28.841ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-21T05:41:28.841ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3112024-12-21T05:41:28.875ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122024-12-21T05:41:28.883ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/zone file = sled-storage/src/dataset.rs:302
3132024-12-21T05:41:29.022ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_871c983c-3586-410a-849e-2f5b0cbe8e62 file = sled-storage/src/dataset.rs:388
3142024-12-21T05:41:29.031ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3152024-12-21T05:41:29.031ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3162024-12-21T05:41:29.031ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3172024-12-21T05:41:29.031ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3182024-12-21T05:41:29.031ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3192024-12-21T05:41:29.041ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3202024-12-21T05:41:29.041ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool)
3212024-12-21T05:41:29.135ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }
3222024-12-21T05:41:29.144ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3232024-12-21T05:41:29.144ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3242024-12-21T05:41:29.144ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3252024-12-21T05:41:29.144ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3262024-12-21T05:41:29.144ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272024-12-21T05:41:29.144ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-12-21T05:41:29.144ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3292024-12-21T05:41:29.178ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3302024-12-21T05:41:29.186ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/zone file = sled-storage/src/dataset.rs:302
3312024-12-21T05:41:29.323ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a file = sled-storage/src/dataset.rs:388
3322024-12-21T05:41:29.331ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3332024-12-21T05:41:29.331ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3342024-12-21T05:41:29.331ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3352024-12-21T05:41:29.331ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3362024-12-21T05:41:29.331ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3372024-12-21T05:41:29.341ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3382024-12-21T05:41:29.341ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool)
3392024-12-21T05:41:29.434ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }
3402024-12-21T05:41:29.441ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3412024-12-21T05:41:29.441ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3422024-12-21T05:41:29.441ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3432024-12-21T05:41:29.442ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3442024-12-21T05:41:29.442ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3452024-12-21T05:41:29.442ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462024-12-21T05:41:29.442ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3472024-12-21T05:41:29.477ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3482024-12-21T05:41:29.485ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722/crypt/zone file = sled-storage/src/dataset.rs:302
3492024-12-21T05:41:29.562ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/67885466-b1c6-48f5-a800-f848c80749b6) file = sled-agent/src/probe_manager.rs:231 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
3502024-12-21T05:41:29.624ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722 file = sled-storage/src/dataset.rs:388
3512024-12-21T05:41:29.631ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522024-12-21T05:41:29.631ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532024-12-21T05:41:29.631ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542024-12-21T05:41:29.631ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552024-12-21T05:41:29.631ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562024-12-21T05:41:29.642ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572024-12-21T05:41:29.642ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool)
3582024-12-21T05:41:29.740ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }
3592024-12-21T05:41:29.748ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3602024-12-21T05:41:29.748ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3612024-12-21T05:41:29.748ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3622024-12-21T05:41:29.748ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3632024-12-21T05:41:29.748ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642024-12-21T05:41:29.748ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-21T05:41:29.748ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3662024-12-21T05:41:29.784ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672024-12-21T05:41:29.792ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/zone file = sled-storage/src/dataset.rs:302
3682024-12-21T05:41:29.929ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb file = sled-storage/src/dataset.rs:388
3692024-12-21T05:41:29.937ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702024-12-21T05:41:29.937ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712024-12-21T05:41:29.937ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722024-12-21T05:41:29.937ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732024-12-21T05:41:29.937ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742024-12-21T05:41:29.947ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752024-12-21T05:41:29.947ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool)
3762024-12-21T05:41:30.045ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }
3772024-12-21T05:41:30.053ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3782024-12-21T05:41:30.054ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3792024-12-21T05:41:30.054ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3802024-12-21T05:41:30.054ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3812024-12-21T05:41:30.054ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822024-12-21T05:41:30.054ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-12-21T05:41:30.054ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3842024-12-21T05:41:30.089ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3852024-12-21T05:41:30.098ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/zone file = sled-storage/src/dataset.rs:302
3862024-12-21T05:41:30.237ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9 file = sled-storage/src/dataset.rs:388
3872024-12-21T05:41:30.245ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3882024-12-21T05:41:30.245ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3892024-12-21T05:41:30.245ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3902024-12-21T05:41:30.245ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3912024-12-21T05:41:30.245ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3922024-12-21T05:41:30.255ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3932024-12-21T05:41:30.255ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool)
3942024-12-21T05:41:30.354ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }
3952024-12-21T05:41:30.363ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3962024-12-21T05:41:30.363ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3972024-12-21T05:41:30.363ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3982024-12-21T05:41:30.363ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3992024-12-21T05:41:30.363ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4002024-12-21T05:41:30.363ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012024-12-21T05:41:30.363ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4022024-12-21T05:41:30.405ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4032024-12-21T05:41:30.415ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0/crypt/zone file = sled-storage/src/dataset.rs:302
4042024-12-21T05:41:30.558ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 file = sled-storage/src/dataset.rs:388
4052024-12-21T05:41:30.564ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/67885466-b1c6-48f5-a800-f848c80749b6) file = sled-agent/src/probe_manager.rs:231 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
4062024-12-21T05:41:30.567ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4072024-12-21T05:41:30.567ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4082024-12-21T05:41:30.567ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4092024-12-21T05:41:30.567ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4102024-12-21T05:41:30.567ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4112024-12-21T05:41:30.577ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4122024-12-21T05:41:30.577ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool)
4132024-12-21T05:41:30.676ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }
4142024-12-21T05:41:30.684ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4152024-12-21T05:41:30.684ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4162024-12-21T05:41:30.684ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4172024-12-21T05:41:30.684ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4182024-12-21T05:41:30.684ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192024-12-21T05:41:30.684ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-21T05:41:30.684ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4212024-12-21T05:41:30.722ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222024-12-21T05:41:30.731ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/zone file = sled-storage/src/dataset.rs:302
4232024-12-21T05:41:30.873ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fa625e73-0c39-487d-9929-b234b9ea83f9 file = sled-storage/src/dataset.rs:388
4242024-12-21T05:41:30.881ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252024-12-21T05:41:30.881ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262024-12-21T05:41:30.881ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272024-12-21T05:41:30.882ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c2c552a1-f416-4f8c-90e9-2c18efd74095 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8e1195b9-2419-4586-9028-afdd4f181dd0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282024-12-21T05:41:30.882ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292024-12-21T05:41:30.882ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302024-12-21T05:41:30.882ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312024-12-21T05:41:30.882ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
4322024-12-21T05:41:30.882ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4332024-12-21T05:41:30.882ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
4342024-12-21T05:41:30.882ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
4352024-12-21T05:41:30.882ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
4362024-12-21T05:41:30.882ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
4372024-12-21T05:41:30.882ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
4382024-12-21T05:41:30.882ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392024-12-21T05:41:30.882ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
4402024-12-21T05:41:30.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3929744 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42923 req_id = 1c8a4c52-6933-43b3-9493-5418a515d49b response_code = 200 uri = /omicron-physical-disks
4412024-12-21T05:41:30.915ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00efb99c-cd7a-4637-9a77-0dad083e8228 (dataset): DatasetConfig { id: 00efb99c-cd7a-4637-9a77-0dad083e8228 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 022f0d19-f44a-467f-b56d-4b71c31e3777 (dataset): DatasetConfig { id: 022f0d19-f44a-467f-b56d-4b71c31e3777 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04a2f527-e10d-4603-be81-3b38069fbcd4 (dataset): DatasetConfig { id: 04a2f527-e10d-4603-be81-3b38069fbcd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 081a2763-6330-41a0-b4fd-145ee4750f51 (dataset): DatasetConfig { id: 081a2763-6330-41a0-b4fd-145ee4750f51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08d3eba9-8c47-4158-9462-d19f1e3282c1 (dataset): DatasetConfig { id: 08d3eba9-8c47-4158-9462-d19f1e3282c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0ea183b3-23a0-49e8-91cf-76b935994c5e (dataset): DatasetConfig { id: 0ea183b3-23a0-49e8-91cf-76b935994c5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11be9a12-4279-459d-bd8c-f87e1cc0c61c (dataset): DatasetConfig { id: 11be9a12-4279-459d-bd8c-f87e1cc0c61c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14eba2f4-afb1-4b6a-a213-58d72676107c (dataset): DatasetConfig { id: 14eba2f4-afb1-4b6a-a213-58d72676107c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 152e253b-67f3-4326-9ce0-e4c3f88f1908 (dataset): DatasetConfig { id: 152e253b-67f3-4326-9ce0-e4c3f88f1908 (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 15c4ab85-169c-4045-8a23-690e0121790e (dataset): DatasetConfig { id: 15c4ab85-169c-4045-8a23-690e0121790e (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f7e8b97-10d6-458b-9de9-8a43c28aa001 (dataset): DatasetConfig { id: 1f7e8b97-10d6-458b-9de9-8a43c28aa001 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20fccfa7-ddc6-4fb3-923b-281fc2d63467 (dataset): DatasetConfig { id: 20fccfa7-ddc6-4fb3-923b-281fc2d63467 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f20be27-8524-4b4b-8ef4-16acd441606b (dataset): DatasetConfig { id: 2f20be27-8524-4b4b-8ef4-16acd441606b (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3042a89e-5d28-48f9-93c3-46c4bcf24a29 (dataset): DatasetConfig { id: 3042a89e-5d28-48f9-93c3-46c4bcf24a29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3483ddfd-cba6-459a-9e46-ff6b07963815 (dataset): DatasetConfig { id: 3483ddfd-cba6-459a-9e46-ff6b07963815 (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 35d91ec4-37b1-48a8-90b7-cfb50761491f (dataset): DatasetConfig { id: 35d91ec4-37b1-48a8-90b7-cfb50761491f (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 361dbdee-0d9c-42a7-a39d-524b43551c58 (dataset): DatasetConfig { id: 361dbdee-0d9c-42a7-a39d-524b43551c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39491299-b70b-48f5-878c-53befe16fd3f (dataset): DatasetConfig { id: 39491299-b70b-48f5-878c-53befe16fd3f (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39524656-0643-4e65-8eb0-0ddc4e99673b (dataset): DatasetConfig { id: 39524656-0643-4e65-8eb0-0ddc4e99673b (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ee04be4-b95a-4012-bfdc-8172f72c91c7 (dataset): DatasetConfig { id: 3ee04be4-b95a-4012-bfdc-8172f72c91c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 445bb407-115b-487b-b406-74eb87e072cc (dataset): DatasetConfig { id: 445bb407-115b-487b-b406-74eb87e072cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ce5100b-c933-4399-b274-467220ca35ab (dataset): DatasetConfig { id: 4ce5100b-c933-4399-b274-467220ca35ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5638507f-b378-40fa-80ce-edf7dbb669d7 (dataset): DatasetConfig { id: 5638507f-b378-40fa-80ce-edf7dbb669d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 587830ac-af2e-48b6-9a7d-46097b56ce2c (dataset): DatasetConfig { id: 587830ac-af2e-48b6-9a7d-46097b56ce2c (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5eccb734-78a2-4894-9ae8-37fb855fe336 (dataset): DatasetConfig { id: 5eccb734-78a2-4894-9ae8-37fb855fe336 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61dea6ca-7b85-4769-9e3b-50ad38bfbc90 (dataset): DatasetConfig { id: 61dea6ca-7b85-4769-9e3b-50ad38bfbc90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73a9492f-f54d-4454-acb5-b5ef032223ac (dataset): DatasetConfig { id: 73a9492f-f54d-4454-acb5-b5ef032223ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a68919e-58df-48d5-99b9-5aa9ef9aacae (dataset): DatasetConfig { id: 7a68919e-58df-48d5-99b9-5aa9ef9aacae (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7d9379b4-338c-4518-a1d3-4c3c9acecf89 (dataset): DatasetConfig { id: 7d9379b4-338c-4518-a1d3-4c3c9acecf89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 808a0458-b504-4c87-bddf-aeba66dd63ae (dataset): DatasetConfig { id: 808a0458-b504-4c87-bddf-aeba66dd63ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83a6a6f8-85b8-4177-b0f6-02f793d8fdd5 (dataset): DatasetConfig { id: 83a6a6f8-85b8-4177-b0f6-02f793d8fdd5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e53a734-1558-4430-a715-5bac3fb77242 (dataset): DatasetConfig { id: 8e53a734-1558-4430-a715-5bac3fb77242 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fdbe2db-25dd-4115-abde-bb676fab678c (dataset): DatasetConfig { id: 8fdbe2db-25dd-4115-abde-bb676fab678c (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9137140a-0f48-4d3b-964e-e76011ae1083 (dataset): DatasetConfig { id: 9137140a-0f48-4d3b-964e-e76011ae1083 (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91e782f5-2f8c-4adb-94ba-bb7176cfa875 (dataset): DatasetConfig { id: 91e782f5-2f8c-4adb-94ba-bb7176cfa875 (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 944dfc39-879d-4b1d-b3b0-414f8072e284 (dataset): DatasetConfig { id: 944dfc39-879d-4b1d-b3b0-414f8072e284 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95ef50b0-35a8-4640-9e03-6b44828242f1 (dataset): DatasetConfig { id: 95ef50b0-35a8-4640-9e03-6b44828242f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 966dc008-e772-46a1-bba7-d75ef1c2f185 (dataset): DatasetConfig { id: 966dc008-e772-46a1-bba7-d75ef1c2f185 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9c7b25b8-c108-4e3e-a6d9-261102e767a4 (dataset): DatasetConfig { id: 9c7b25b8-c108-4e3e-a6d9-261102e767a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0497d54-9fb4-4ece-b4ee-678e1db2fbf0 (dataset): DatasetConfig { id: a0497d54-9fb4-4ece-b4ee-678e1db2fbf0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3e49274-69c8-41c4-b1b5-5c7034732a68 (dataset): DatasetConfig { id: a3e49274-69c8-41c4-b1b5-5c7034732a68 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a62ca051-e3b3-4676-9afc-c28e1aeb4ab9 (dataset): DatasetConfig { id: a62ca051-e3b3-4676-9afc-c28e1aeb4ab9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a944b1df-c6ee-4313-9ec3-e59b765e2868 (dataset): DatasetConfig { id: a944b1df-c6ee-4313-9ec3-e59b765e2868 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac24daf7-5329-4fad-bfb9-6cdd4baf1ce3 (dataset): DatasetConfig { id: ac24daf7-5329-4fad-bfb9-6cdd4baf1ce3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aebadbc8-c553-4049-ac20-8c24906c836e (dataset): DatasetConfig { id: aebadbc8-c553-4049-ac20-8c24906c836e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0ea1ad5-d86e-4dc5-b52e-f75a80ab29ba (dataset): DatasetConfig { id: b0ea1ad5-d86e-4dc5-b52e-f75a80ab29ba (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7ac67a7-1389-498e-95a7-678374e7efa1 (dataset): DatasetConfig { id: b7ac67a7-1389-498e-95a7-678374e7efa1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bc8caa35-e014-4c5c-a485-ba5460c4b67e (dataset): DatasetConfig { id: bc8caa35-e014-4c5c-a485-ba5460c4b67e (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0f7394d-1007-455d-9976-c06c15b6fc27 (dataset): DatasetConfig { id: c0f7394d-1007-455d-9976-c06c15b6fc27 (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c162c6e9-57a3-4b2c-9f29-e2781c64f53f (dataset): DatasetConfig { id: c162c6e9-57a3-4b2c-9f29-e2781c64f53f (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c564ace4-33c4-460c-9c49-c4c188df33e4 (dataset): DatasetConfig { id: c564ace4-33c4-460c-9c49-c4c188df33e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5690b54-9762-4922-9ec4-67568aa2d7ab (dataset): DatasetConfig { id: c5690b54-9762-4922-9ec4-67568aa2d7ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca37420f-adcd-47d5-a2e5-58ab72a24676 (dataset): DatasetConfig { id: ca37420f-adcd-47d5-a2e5-58ab72a24676 (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4868d51-dea6-4fbb-85d9-e415276d5deb (dataset): DatasetConfig { id: d4868d51-dea6-4fbb-85d9-e415276d5deb (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5a77787-c2ca-476d-8ffb-f73a3573d6f3 (dataset): DatasetConfig { id: d5a77787-c2ca-476d-8ffb-f73a3573d6f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9964064-cbf3-43d0-b474-92e1f594f9fa (dataset): DatasetConfig { id: d9964064-cbf3-43d0-b474-92e1f594f9fa (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e24e3ca9-4918-49e6-9a0b-d30a5d63e6a4 (dataset): DatasetConfig { id: e24e3ca9-4918-49e6-9a0b-d30a5d63e6a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee262873-edec-466f-b308-b89d5e441fb1 (dataset): DatasetConfig { id: ee262873-edec-466f-b308-b89d5e441fb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ee314b1a-d739-4ab5-b7c4-3089cc079e5c (dataset): DatasetConfig { id: ee314b1a-d739-4ab5-b7c4-3089cc079e5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f26daf2d-3100-4db4-b20f-d2e39f76306f (dataset): DatasetConfig { id: f26daf2d-3100-4db4-b20f-d2e39f76306f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2b83524-9d16-46d3-b1ef-dfaf8ea54188 (dataset): DatasetConfig { id: f2b83524-9d16-46d3-b1ef-dfaf8ea54188 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f46ccfe2-b41d-4e87-b3bd-5ee839843918 (dataset): DatasetConfig { id: f46ccfe2-b41d-4e87-b3bd-5ee839843918 (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f829d7d4-34cf-42a6-854a-13e21790944e (dataset): DatasetConfig { id: f829d7d4-34cf-42a6-854a-13e21790944e (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f97c3f22-81e6-4fbb-9d6d-5aa0ff855a3a (dataset): DatasetConfig { id: f97c3f22-81e6-4fbb-9d6d-5aa0ff855a3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd3846bc-1510-4c9e-bb26-9e668593ca92 (dataset): DatasetConfig { id: fd3846bc-1510-4c9e-bb26-9e668593ca92 (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff619903-8f64-44f5-8d9f-20f38bcd6cdc (dataset): DatasetConfig { id: ff619903-8f64-44f5-8d9f-20f38bcd6cdc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422024-12-21T05:41:30.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55693
4432024-12-21T05:41:30.915ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
4442024-12-21T05:41:30.916ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00efb99c-cd7a-4637-9a77-0dad083e8228 (dataset): DatasetConfig { id: 00efb99c-cd7a-4637-9a77-0dad083e8228 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 022f0d19-f44a-467f-b56d-4b71c31e3777 (dataset): DatasetConfig { id: 022f0d19-f44a-467f-b56d-4b71c31e3777 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04a2f527-e10d-4603-be81-3b38069fbcd4 (dataset): DatasetConfig { id: 04a2f527-e10d-4603-be81-3b38069fbcd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 081a2763-6330-41a0-b4fd-145ee4750f51 (dataset): DatasetConfig { id: 081a2763-6330-41a0-b4fd-145ee4750f51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08d3eba9-8c47-4158-9462-d19f1e3282c1 (dataset): DatasetConfig { id: 08d3eba9-8c47-4158-9462-d19f1e3282c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0ea183b3-23a0-49e8-91cf-76b935994c5e (dataset): DatasetConfig { id: 0ea183b3-23a0-49e8-91cf-76b935994c5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11be9a12-4279-459d-bd8c-f87e1cc0c61c (dataset): DatasetConfig { id: 11be9a12-4279-459d-bd8c-f87e1cc0c61c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14eba2f4-afb1-4b6a-a213-58d72676107c (dataset): DatasetConfig { id: 14eba2f4-afb1-4b6a-a213-58d72676107c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 152e253b-67f3-4326-9ce0-e4c3f88f1908 (dataset): DatasetConfig { id: 152e253b-67f3-4326-9ce0-e4c3f88f1908 (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 15c4ab85-169c-4045-8a23-690e0121790e (dataset): DatasetConfig { id: 15c4ab85-169c-4045-8a23-690e0121790e (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f7e8b97-10d6-458b-9de9-8a43c28aa001 (dataset): DatasetConfig { id: 1f7e8b97-10d6-458b-9de9-8a43c28aa001 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20fccfa7-ddc6-4fb3-923b-281fc2d63467 (dataset): DatasetConfig { id: 20fccfa7-ddc6-4fb3-923b-281fc2d63467 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f20be27-8524-4b4b-8ef4-16acd441606b (dataset): DatasetConfig { id: 2f20be27-8524-4b4b-8ef4-16acd441606b (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3042a89e-5d28-48f9-93c3-46c4bcf24a29 (dataset): DatasetConfig { id: 3042a89e-5d28-48f9-93c3-46c4bcf24a29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3483ddfd-cba6-459a-9e46-ff6b07963815 (dataset): DatasetConfig { id: 3483ddfd-cba6-459a-9e46-ff6b07963815 (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 35d91ec4-37b1-48a8-90b7-cfb50761491f (dataset): DatasetConfig { id: 35d91ec4-37b1-48a8-90b7-cfb50761491f (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 361dbdee-0d9c-42a7-a39d-524b43551c58 (dataset): DatasetConfig { id: 361dbdee-0d9c-42a7-a39d-524b43551c58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39491299-b70b-48f5-878c-53befe16fd3f (dataset): DatasetConfig { id: 39491299-b70b-48f5-878c-53befe16fd3f (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39524656-0643-4e65-8eb0-0ddc4e99673b (dataset): DatasetConfig { id: 39524656-0643-4e65-8eb0-0ddc4e99673b (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ee04be4-b95a-4012-bfdc-8172f72c91c7 (dataset): DatasetConfig { id: 3ee04be4-b95a-4012-bfdc-8172f72c91c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 445bb407-115b-487b-b406-74eb87e072cc (dataset): DatasetConfig { id: 445bb407-115b-487b-b406-74eb87e072cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ce5100b-c933-4399-b274-467220ca35ab (dataset): DatasetConfig { id: 4ce5100b-c933-4399-b274-467220ca35ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5638507f-b378-40fa-80ce-edf7dbb669d7 (dataset): DatasetConfig { id: 5638507f-b378-40fa-80ce-edf7dbb669d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 587830ac-af2e-48b6-9a7d-46097b56ce2c (dataset): DatasetConfig { id: 587830ac-af2e-48b6-9a7d-46097b56ce2c (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5eccb734-78a2-4894-9ae8-37fb855fe336 (dataset): DatasetConfig { id: 5eccb734-78a2-4894-9ae8-37fb855fe336 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61dea6ca-7b85-4769-9e3b-50ad38bfbc90 (dataset): DatasetConfig { id: 61dea6ca-7b85-4769-9e3b-50ad38bfbc90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 73a9492f-f54d-4454-acb5-b5ef032223ac (dataset): DatasetConfig { id: 73a9492f-f54d-4454-acb5-b5ef032223ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a68919e-58df-48d5-99b9-5aa9ef9aacae (dataset): DatasetConfig { id: 7a68919e-58df-48d5-99b9-5aa9ef9aacae (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7d9379b4-338c-4518-a1d3-4c3c9acecf89 (dataset): DatasetConfig { id: 7d9379b4-338c-4518-a1d3-4c3c9acecf89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 808a0458-b504-4c87-bddf-aeba66dd63ae (dataset): DatasetConfig { id: 808a0458-b504-4c87-bddf-aeba66dd63ae (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83a6a6f8-85b8-4177-b0f6-02f793d8fdd5 (dataset): DatasetConfig { id: 83a6a6f8-85b8-4177-b0f6-02f793d8fdd5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e53a734-1558-4430-a715-5bac3fb77242 (dataset): DatasetConfig { id: 8e53a734-1558-4430-a715-5bac3fb77242 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fdbe2db-25dd-4115-abde-bb676fab678c (dataset): DatasetConfig { id: 8fdbe2db-25dd-4115-abde-bb676fab678c (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9137140a-0f48-4d3b-964e-e76011ae1083 (dataset): DatasetConfig { id: 9137140a-0f48-4d3b-964e-e76011ae1083 (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91e782f5-2f8c-4adb-94ba-bb7176cfa875 (dataset): DatasetConfig { id: 91e782f5-2f8c-4adb-94ba-bb7176cfa875 (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 944dfc39-879d-4b1d-b3b0-414f8072e284 (dataset): DatasetConfig { id: 944dfc39-879d-4b1d-b3b0-414f8072e284 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95ef50b0-35a8-4640-9e03-6b44828242f1 (dataset): DatasetConfig { id: 95ef50b0-35a8-4640-9e03-6b44828242f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 966dc008-e772-46a1-bba7-d75ef1c2f185 (dataset): DatasetConfig { id: 966dc008-e772-46a1-bba7-d75ef1c2f185 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9c7b25b8-c108-4e3e-a6d9-261102e767a4 (dataset): DatasetConfig { id: 9c7b25b8-c108-4e3e-a6d9-261102e767a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0497d54-9fb4-4ece-b4ee-678e1db2fbf0 (dataset): DatasetConfig { id: a0497d54-9fb4-4ece-b4ee-678e1db2fbf0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3e49274-69c8-41c4-b1b5-5c7034732a68 (dataset): DatasetConfig { id: a3e49274-69c8-41c4-b1b5-5c7034732a68 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a62ca051-e3b3-4676-9afc-c28e1aeb4ab9 (dataset): DatasetConfig { id: a62ca051-e3b3-4676-9afc-c28e1aeb4ab9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a944b1df-c6ee-4313-9ec3-e59b765e2868 (dataset): DatasetConfig { id: a944b1df-c6ee-4313-9ec3-e59b765e2868 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac24daf7-5329-4fad-bfb9-6cdd4baf1ce3 (dataset): DatasetConfig { id: ac24daf7-5329-4fad-bfb9-6cdd4baf1ce3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aebadbc8-c553-4049-ac20-8c24906c836e (dataset): DatasetConfig { id: aebadbc8-c553-4049-ac20-8c24906c836e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0ea1ad5-d86e-4dc5-b52e-f75a80ab29ba (dataset): DatasetConfig { id: b0ea1ad5-d86e-4dc5-b52e-f75a80ab29ba (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7ac67a7-1389-498e-95a7-678374e7efa1 (dataset): DatasetConfig { id: b7ac67a7-1389-498e-95a7-678374e7efa1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bc8caa35-e014-4c5c-a485-ba5460c4b67e (dataset): DatasetConfig { id: bc8caa35-e014-4c5c-a485-ba5460c4b67e (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0f7394d-1007-455d-9976-c06c15b6fc27 (dataset): DatasetConfig { id: c0f7394d-1007-455d-9976-c06c15b6fc27 (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c162c6e9-57a3-4b2c-9f29-e2781c64f53f (dataset): DatasetConfig { id: c162c6e9-57a3-4b2c-9f29-e2781c64f53f (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c564ace4-33c4-460c-9c49-c4c188df33e4 (dataset): DatasetConfig { id: c564ace4-33c4-460c-9c49-c4c188df33e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5690b54-9762-4922-9ec4-67568aa2d7ab (dataset): DatasetConfig { id: c5690b54-9762-4922-9ec4-67568aa2d7ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca37420f-adcd-47d5-a2e5-58ab72a24676 (dataset): DatasetConfig { id: ca37420f-adcd-47d5-a2e5-58ab72a24676 (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4868d51-dea6-4fbb-85d9-e415276d5deb (dataset): DatasetConfig { id: d4868d51-dea6-4fbb-85d9-e415276d5deb (dataset), name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5a77787-c2ca-476d-8ffb-f73a3573d6f3 (dataset): DatasetConfig { id: d5a77787-c2ca-476d-8ffb-f73a3573d6f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9964064-cbf3-43d0-b474-92e1f594f9fa (dataset): DatasetConfig { id: d9964064-cbf3-43d0-b474-92e1f594f9fa (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e24e3ca9-4918-49e6-9a0b-d30a5d63e6a4 (dataset): DatasetConfig { id: e24e3ca9-4918-49e6-9a0b-d30a5d63e6a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee262873-edec-466f-b308-b89d5e441fb1 (dataset): DatasetConfig { id: ee262873-edec-466f-b308-b89d5e441fb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ee314b1a-d739-4ab5-b7c4-3089cc079e5c (dataset): DatasetConfig { id: ee314b1a-d739-4ab5-b7c4-3089cc079e5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f26daf2d-3100-4db4-b20f-d2e39f76306f (dataset): DatasetConfig { id: f26daf2d-3100-4db4-b20f-d2e39f76306f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2b83524-9d16-46d3-b1ef-dfaf8ea54188 (dataset): DatasetConfig { id: f2b83524-9d16-46d3-b1ef-dfaf8ea54188 (dataset), name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f46ccfe2-b41d-4e87-b3bd-5ee839843918 (dataset): DatasetConfig { id: f46ccfe2-b41d-4e87-b3bd-5ee839843918 (dataset), name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f829d7d4-34cf-42a6-854a-13e21790944e (dataset): DatasetConfig { id: f829d7d4-34cf-42a6-854a-13e21790944e (dataset), name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f97c3f22-81e6-4fbb-9d6d-5aa0ff855a3a (dataset): DatasetConfig { id: f97c3f22-81e6-4fbb-9d6d-5aa0ff855a3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd3846bc-1510-4c9e-bb26-9e668593ca92 (dataset): DatasetConfig { id: fd3846bc-1510-4c9e-bb26-9e668593ca92 (dataset), name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff619903-8f64-44f5-8d9f-20f38bcd6cdc (dataset): DatasetConfig { id: ff619903-8f64-44f5-8d9f-20f38bcd6cdc (dataset), name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4452024-12-21T05:41:30.916ZINFOSledAgent (StorageManager): No ledger in /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462024-12-21T05:41:30.916ZINFOSledAgent (StorageManager): No ledger in /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472024-12-21T05:41:30.916ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4482024-12-21T05:41:30.931ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4492024-12-21T05:41:30.931ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4502024-12-21T05:41:30.931ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone/oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone/oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978" } file = sled-storage/src/manager.rs:1431
4512024-12-21T05:41:31.005ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4522024-12-21T05:41:31.005ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4532024-12-21T05:41:31.005ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4542024-12-21T05:41:31.055ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552024-12-21T05:41:31.055ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4562024-12-21T05:41:31.055ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/zone"), full_name: "oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/zone" } file = sled-storage/src/manager.rs:1431
4572024-12-21T05:41:31.086ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582024-12-21T05:41:31.086ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4592024-12-21T05:41:31.086ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3351d590-858e-45b6-91ff-51f0d9e17995/crypt/zone"), full_name: "oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crypt/zone" } file = sled-storage/src/manager.rs:1431
4602024-12-21T05:41:31.116ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612024-12-21T05:41:31.116ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4622024-12-21T05:41:31.116ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/debug"), full_name: "oxp_fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/debug" } file = sled-storage/src/manager.rs:1431
4632024-12-21T05:41:31.146ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642024-12-21T05:41:31.146ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4652024-12-21T05:41:31.146ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4662024-12-21T05:41:31.199ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672024-12-21T05:41:31.199ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4682024-12-21T05:41:31.199ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4692024-12-21T05:41:31.250ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702024-12-21T05:41:31.250ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4712024-12-21T05:41:31.250ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4722024-12-21T05:41:31.301ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4732024-12-21T05:41:31.301ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4742024-12-21T05:41:31.301ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/debug"), full_name: "oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/debug" } file = sled-storage/src/manager.rs:1431
4752024-12-21T05:41:31.331ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4762024-12-21T05:41:31.331ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4772024-12-21T05:41:31.331ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fa625e73-0c39-487d-9929-b234b9ea83f9/crucible" } file = sled-storage/src/manager.rs:1431
4782024-12-21T05:41:31.381ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4792024-12-21T05:41:31.381ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4802024-12-21T05:41:31.381ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/zone/oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9"), full_name: "oxp_fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/zone/oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9" } file = sled-storage/src/manager.rs:1431
4812024-12-21T05:41:31.441ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4822024-12-21T05:41:31.441ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4832024-12-21T05:41:31.441ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0/crypt/zone/oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153"), full_name: "oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0/crypt/zone/oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153" } file = sled-storage/src/manager.rs:1431
4842024-12-21T05:41:31.502ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852024-12-21T05:41:31.502ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4862024-12-21T05:41:31.502ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crucible" } file = sled-storage/src/manager.rs:1431
4872024-12-21T05:41:31.551ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882024-12-21T05:41:31.551ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4892024-12-21T05:41:31.551ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4902024-12-21T05:41:31.566ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/67885466-b1c6-48f5-a800-f848c80749b6) file = sled-agent/src/probe_manager.rs:231 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
4912024-12-21T05:41:31.601ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922024-12-21T05:41:31.601ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4932024-12-21T05:41:31.601ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/144378a5-cfc6-44e1-8dd6-f07860f0a722/crypt/debug"), full_name: "oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722/crypt/debug" } file = sled-storage/src/manager.rs:1431
4942024-12-21T05:41:31.632ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952024-12-21T05:41:31.632ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962024-12-21T05:41:31.632ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/zone/oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8"), full_name: "oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/zone/oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8" } file = sled-storage/src/manager.rs:1431
4972024-12-21T05:41:31.692ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982024-12-21T05:41:31.692ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992024-12-21T05:41:31.692ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_871c983c-3586-410a-849e-2f5b0cbe8e62/crucible" } file = sled-storage/src/manager.rs:1431
5002024-12-21T05:41:31.741ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012024-12-21T05:41:31.741ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5022024-12-21T05:41:31.741ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crucible" } file = sled-storage/src/manager.rs:1431
5032024-12-21T05:41:31.791ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042024-12-21T05:41:31.791ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5052024-12-21T05:41:31.791ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/144378a5-cfc6-44e1-8dd6-f07860f0a722/crypt/zone/oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d"), full_name: "oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722/crypt/zone/oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d" } file = sled-storage/src/manager.rs:1431
5062024-12-21T05:41:31.853ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072024-12-21T05:41:31.853ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082024-12-21T05:41:31.853ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/zone/oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7"), full_name: "oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/zone/oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7" } file = sled-storage/src/manager.rs:1431
5092024-12-21T05:41:31.914ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102024-12-21T05:41:31.914ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112024-12-21T05:41:31.914ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722/crucible" } file = sled-storage/src/manager.rs:1431
5122024-12-21T05:41:31.964ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132024-12-21T05:41:31.964ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5142024-12-21T05:41:31.964ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/zone/oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d"), full_name: "oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/zone/oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d" } file = sled-storage/src/manager.rs:1431
5152024-12-21T05:41:32.027ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162024-12-21T05:41:32.027ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5172024-12-21T05:41:32.027ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone/oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone/oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f" } file = sled-storage/src/manager.rs:1431
5182024-12-21T05:41:32.088ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192024-12-21T05:41:32.088ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202024-12-21T05:41:32.088ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/zone/oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114"), full_name: "oxp_871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/zone/oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114" } file = sled-storage/src/manager.rs:1431
5212024-12-21T05:41:32.147ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222024-12-21T05:41:32.147ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5232024-12-21T05:41:32.147ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/zone/oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2"), full_name: "oxp_871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/zone/oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2" } file = sled-storage/src/manager.rs:1431
5242024-12-21T05:41:32.207ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252024-12-21T05:41:32.207ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262024-12-21T05:41:32.207ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5272024-12-21T05:41:32.257ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282024-12-21T05:41:32.257ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5292024-12-21T05:41:32.257ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3351d590-858e-45b6-91ff-51f0d9e17995/crypt/zone/oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c"), full_name: "oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crypt/zone/oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c" } file = sled-storage/src/manager.rs:1431
5302024-12-21T05:41:32.316ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5312024-12-21T05:41:32.316ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5322024-12-21T05:41:32.316ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0/crypt/debug"), full_name: "oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0/crypt/debug" } file = sled-storage/src/manager.rs:1431
5332024-12-21T05:41:32.346ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5342024-12-21T05:41:32.346ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5352024-12-21T05:41:32.346ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/zone/oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710"), full_name: "oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/zone/oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710" } file = sled-storage/src/manager.rs:1431
5362024-12-21T05:41:32.407ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5372024-12-21T05:41:32.407ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5382024-12-21T05:41:32.407ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone" } file = sled-storage/src/manager.rs:1431
5392024-12-21T05:41:32.439ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5402024-12-21T05:41:32.439ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5412024-12-21T05:41:32.439ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/zone"), full_name: "oxp_871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/zone" } file = sled-storage/src/manager.rs:1431
5422024-12-21T05:41:32.469ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5432024-12-21T05:41:32.469ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5442024-12-21T05:41:32.469ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/zone/oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3"), full_name: "oxp_fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/zone/oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3" } file = sled-storage/src/manager.rs:1431
5452024-12-21T05:41:32.530ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5462024-12-21T05:41:32.530ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5472024-12-21T05:41:32.530ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/debug"), full_name: "oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/debug" } file = sled-storage/src/manager.rs:1431
5482024-12-21T05:41:32.559ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5492024-12-21T05:41:32.559ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5502024-12-21T05:41:32.559ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crucible" } file = sled-storage/src/manager.rs:1431
5512024-12-21T05:41:32.570ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/67885466-b1c6-48f5-a800-f848c80749b6) file = sled-agent/src/probe_manager.rs:231 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
5522024-12-21T05:41:32.610ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532024-12-21T05:41:32.610ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5542024-12-21T05:41:32.610ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/144378a5-cfc6-44e1-8dd6-f07860f0a722/crypt/zone"), full_name: "oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722/crypt/zone" } file = sled-storage/src/manager.rs:1431
5552024-12-21T05:41:32.640ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562024-12-21T05:41:32.640ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5572024-12-21T05:41:32.640ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/zone/oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89"), full_name: "oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/zone/oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89" } file = sled-storage/src/manager.rs:1431
5582024-12-21T05:41:32.699ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592024-12-21T05:41:32.699ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602024-12-21T05:41:32.699ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone/oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone/oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc" } file = sled-storage/src/manager.rs:1431
5612024-12-21T05:41:32.759ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622024-12-21T05:41:32.759ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5632024-12-21T05:41:32.759ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/debug"), full_name: "oxp_871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/debug" } file = sled-storage/src/manager.rs:1431
5642024-12-21T05:41:32.789ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652024-12-21T05:41:32.790ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5662024-12-21T05:41:32.790ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone/oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone/oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa" } file = sled-storage/src/manager.rs:1431
5672024-12-21T05:41:32.850ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682024-12-21T05:41:32.850ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5692024-12-21T05:41:32.850ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crucible" } file = sled-storage/src/manager.rs:1431
5702024-12-21T05:41:32.897ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712024-12-21T05:41:32.897ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5722024-12-21T05:41:32.897ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0/crucible" } file = sled-storage/src/manager.rs:1431
5732024-12-21T05:41:32.945ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742024-12-21T05:41:32.945ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5752024-12-21T05:41:32.945ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/debug"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/debug" } file = sled-storage/src/manager.rs:1431
5762024-12-21T05:41:32.973ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772024-12-21T05:41:32.973ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782024-12-21T05:41:32.973ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5792024-12-21T05:41:33.026ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802024-12-21T05:41:33.026ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5812024-12-21T05:41:33.026ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5822024-12-21T05:41:33.077ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832024-12-21T05:41:33.078ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5842024-12-21T05:41:33.078ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0/crypt/zone"), full_name: "oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0/crypt/zone" } file = sled-storage/src/manager.rs:1431
5852024-12-21T05:41:33.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862024-12-21T05:41:33.106ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5872024-12-21T05:41:33.106ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/zone/oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8"), full_name: "oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/zone/oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8" } file = sled-storage/src/manager.rs:1431
5882024-12-21T05:41:33.164ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892024-12-21T05:41:33.164ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5902024-12-21T05:41:33.164ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3351d590-858e-45b6-91ff-51f0d9e17995/crypt/debug"), full_name: "oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crypt/debug" } file = sled-storage/src/manager.rs:1431
5912024-12-21T05:41:33.193ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922024-12-21T05:41:33.193ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5932024-12-21T05:41:33.193ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/zone"), full_name: "oxp_fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/zone" } file = sled-storage/src/manager.rs:1431
5942024-12-21T05:41:33.223ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952024-12-21T05:41:33.223ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5962024-12-21T05:41:33.223ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/zone/oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), full_name: "oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/zone/oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de" } file = sled-storage/src/manager.rs:1431
5972024-12-21T05:41:33.281ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982024-12-21T05:41:33.281ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5992024-12-21T05:41:33.281ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/zone/oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9"), full_name: "oxp_fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/zone/oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9" } file = sled-storage/src/manager.rs:1431
6002024-12-21T05:41:33.340ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012024-12-21T05:41:33.340ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6022024-12-21T05:41:33.340ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6032024-12-21T05:41:33.390ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042024-12-21T05:41:33.390ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6052024-12-21T05:41:33.390ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/zone"), full_name: "oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/zone" } file = sled-storage/src/manager.rs:1431
6062024-12-21T05:41:33.420ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072024-12-21T05:41:33.420ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6082024-12-21T05:41:33.420ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6092024-12-21T05:41:33.469ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102024-12-21T05:41:33.469ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112024-12-21T05:41:33.469ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone/oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907"), full_name: "oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/zone/oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907" } file = sled-storage/src/manager.rs:1431
6122024-12-21T05:41:33.531ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132024-12-21T05:41:33.531ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142024-12-21T05:41:33.531ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/zone/oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf"), full_name: "oxp_fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/zone/oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf" } file = sled-storage/src/manager.rs:1431
6152024-12-21T05:41:33.573ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/67885466-b1c6-48f5-a800-f848c80749b6) file = sled-agent/src/probe_manager.rs:231 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
6162024-12-21T05:41:33.593ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172024-12-21T05:41:33.593ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182024-12-21T05:41:33.593ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/zone/oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6"), full_name: "oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/zone/oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6" } file = sled-storage/src/manager.rs:1431
6192024-12-21T05:41:33.655ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202024-12-21T05:41:33.655ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212024-12-21T05:41:33.655ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3351d590-858e-45b6-91ff-51f0d9e17995/crypt/zone/oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0"), full_name: "oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crypt/zone/oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0" } file = sled-storage/src/manager.rs:1431
6222024-12-21T05:41:33.717ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232024-12-21T05:41:33.717ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6242024-12-21T05:41:33.717ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/debug"), full_name: "oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/debug" } file = sled-storage/src/manager.rs:1431
6252024-12-21T05:41:33.746ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262024-12-21T05:41:33.746ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6272024-12-21T05:41:33.746ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3351d590-858e-45b6-91ff-51f0d9e17995/crypt/zone/oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41"), full_name: "oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crypt/zone/oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41" } file = sled-storage/src/manager.rs:1431
6282024-12-21T05:41:33.809ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292024-12-21T05:41:33.809ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6302024-12-21T05:41:33.809ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crucible" } file = sled-storage/src/manager.rs:1431
6312024-12-21T05:41:33.858ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322024-12-21T05:41:33.858ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6332024-12-21T05:41:33.858ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/zone/oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1"), full_name: "oxp_871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/zone/oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1" } file = sled-storage/src/manager.rs:1431
6342024-12-21T05:41:33.919ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352024-12-21T05:41:33.919ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362024-12-21T05:41:33.919ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/144378a5-cfc6-44e1-8dd6-f07860f0a722/crypt/zone/oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da"), full_name: "oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722/crypt/zone/oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da" } file = sled-storage/src/manager.rs:1431
6372024-12-21T05:41:33.980ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382024-12-21T05:41:33.980ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6392024-12-21T05:41:33.980ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/zone"), full_name: "oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/zone" } file = sled-storage/src/manager.rs:1431
6402024-12-21T05:41:34.010ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412024-12-21T05:41:34.010ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422024-12-21T05:41:34.010ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6432024-12-21T05:41:34.064ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442024-12-21T05:41:34.064ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452024-12-21T05:41:34.064ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/zone/oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95"), full_name: "oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/zone/oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95" } file = sled-storage/src/manager.rs:1431
6462024-12-21T05:41:34.124ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472024-12-21T05:41:34.124ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6482024-12-21T05:41:34.124ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3351d590-858e-45b6-91ff-51f0d9e17995/crypt/zone/oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49"), full_name: "oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crypt/zone/oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49" } file = sled-storage/src/manager.rs:1431
6492024-12-21T05:41:34.184ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6502024-12-21T05:41:34.185ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512024-12-21T05:41:34.185ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
6522024-12-21T05:41:34.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3270214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55693 req_id = 4c225d00-e6bf-4a63-b542-34578cf2d2f4 response_code = 200 uri = /datasets
6532024-12-21T05:41:34.217ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: a125a34b-4f89-401a-a829-f90fcc658907 (service), filesystem_pool: Some(ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 07fb42e0-3eda-40fb-aaac-0446bc3c8a41 (service), filesystem_pool: Some(ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 6c1e198b-ea7d-436c-9b93-57bdb3386ca2 (service), filesystem_pool: Some(ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6542024-12-21T05:41:34.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59765
6552024-12-21T05:41:34.217ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6562024-12-21T05:41:34.217ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6572024-12-21T05:41:34.227ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6582024-12-21T05:41:34.227ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592024-12-21T05:41:34.236ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602024-12-21T05:41:34.236ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612024-12-21T05:41:34.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6622024-12-21T05:41:34.245ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-zones.json file = common/src/ledger.rs:188
6632024-12-21T05:41:34.245ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-zones.json file = common/src/ledger.rs:188
6642024-12-21T05:41:34.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6652024-12-21T05:41:34.290ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662024-12-21T05:41:34.290ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672024-12-21T05:41:34.290ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682024-12-21T05:41:34.343ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2 file = illumos-utils/src/zone.rs:325
6692024-12-21T05:41:34.347ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41 file = illumos-utils/src/zone.rs:325
6702024-12-21T05:41:34.351ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907 file = illumos-utils/src/zone.rs:325
6712024-12-21T05:41:34.363ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2 file = illumos-utils/src/zone.rs:363
6722024-12-21T05:41:34.368ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41 file = illumos-utils/src/zone.rs:363
6732024-12-21T05:41:34.372ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907 file = illumos-utils/src/zone.rs:363
6742024-12-21T05:41:34.575ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/67885466-b1c6-48f5-a800-f848c80749b6) file = sled-agent/src/probe_manager.rs:231 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
6752024-12-21T05:41:35.974ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6762024-12-21T05:41:35.974ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6772024-12-21T05:41:36.418ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3440864123571746126 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
6782024-12-21T05:41:36.418ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12650709719278949391 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
6792024-12-21T05:41:36.453ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-12-21T05:41:36.927ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6812024-12-21T05:41:36.927ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6822024-12-21T05:41:36.932ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6832024-12-21T05:41:36.932ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842024-12-21T05:41:36.932ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907
6852024-12-21T05:41:36.935ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6862024-12-21T05:41:36.935ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
6872024-12-21T05:41:36.938ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6882024-12-21T05:41:36.938ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
6892024-12-21T05:41:36.943ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
6902024-12-21T05:41:37.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41") failed: Property not found. retry in 60.743029ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
6912024-12-21T05:41:37.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2") failed: Property not found. retry in 55.015014ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
6922024-12-21T05:41:37.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907") failed: Property not found. retry in 68.95951ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907
6932024-12-21T05:41:37.098ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
6942024-12-21T05:41:37.098ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
6952024-12-21T05:41:37.138ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
6962024-12-21T05:41:37.139ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
6972024-12-21T05:41:37.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41") failed: Property not found. retry in 127.998245ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
6982024-12-21T05:41:37.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2") failed: Property not found. retry in 130.750336ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
6992024-12-21T05:41:37.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41") failed: Property not found. retry in 118.942634ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
7002024-12-21T05:41:37.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907") failed: Property not found. retry in 53.037645ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907
7012024-12-21T05:41:37.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2") failed: Property not found. retry in 125.410041ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
7022024-12-21T05:41:37.492ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
7032024-12-21T05:41:37.492ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
7042024-12-21T05:41:37.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907") failed: Property not found. retry in 295.355328ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907
7052024-12-21T05:41:37.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41") failed: Property not found. retry in 417.681239ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
7062024-12-21T05:41:37.573ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
7072024-12-21T05:41:37.573ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
7082024-12-21T05:41:37.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2") failed: Property not found. retry in 367.262742ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
7092024-12-21T05:41:37.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907") failed: Property not found. retry in 451.342168ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907
7102024-12-21T05:41:37.831ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
7112024-12-21T05:41:37.831ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
7122024-12-21T05:41:37.942ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
7132024-12-21T05:41:37.942ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7142024-12-21T05:41:37.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41") failed: Property not found. retry in 644.055867ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
7152024-12-21T05:41:37.979ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7162024-12-21T05:41:38.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2") failed: Property not found. retry in 499.623916ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
7172024-12-21T05:41:38.016ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7182024-12-21T05:41:38.016ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7192024-12-21T05:41:38.016ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7202024-12-21T05:41:38.016ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7212024-12-21T05:41:38.054ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
7222024-12-21T05:41:38.113ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7232024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7242024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7252024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7262024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7272024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7282024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7292024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7302024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7312024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7322024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7332024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7342024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7352024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7362024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7372024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7382024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7392024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7402024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7412024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7422024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7432024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7442024-12-21T05:41:38.113ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7452024-12-21T05:41:38.195ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2809702307794696978 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
7462024-12-21T05:41:38.195ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12099399048174492875 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
7472024-12-21T05:41:38.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907") failed: Property not found. retry in 600.185466ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907
7482024-12-21T05:41:38.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2") failed: Property not found. retry in 760.563694ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
7492024-12-21T05:41:38.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41") failed: Property not found. retry in 1.276023678s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
7502024-12-21T05:41:38.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907") failed: Property not found. retry in 1.48077831s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907
7512024-12-21T05:41:39.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2") failed: Property not found. retry in 1.174565905s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
7522024-12-21T05:41:39.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41") failed: Property not found. retry in 519.046849ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
7532024-12-21T05:41:40.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907") failed: Property not found. retry in 1.165338269s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907
7542024-12-21T05:41:40.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41") failed: Property not found. retry in 1.186147125s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
7552024-12-21T05:41:40.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2") failed: Property not found. retry in 1.342066949s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
7562024-12-21T05:41:41.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907") failed: Property not found. retry in 1.426362189s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907
7572024-12-21T05:41:41.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41") failed: Property not found. retry in 1.270784726s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
7582024-12-21T05:41:41.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2") failed: Property not found. retry in 706.520921ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
7592024-12-21T05:41:42.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2") failed: Property not found. retry in 864.133776ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
7602024-12-21T05:41:42.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41") failed: Property not found. retry in 1.462552955s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
7612024-12-21T05:41:42.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907") failed: Property not found. retry in 1.213690513s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907
7622024-12-21T05:41:43.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2") failed: Property not found. retry in 1.047551059s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
7632024-12-21T05:41:44.471ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_6c1e198b-ea7d-436c-9b93-57bdb3386ca2
7642024-12-21T05:41:44.471ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_07fb42e0-3eda-40fb-aaac-0446bc3c8a41
7652024-12-21T05:41:44.471ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_a125a34b-4f89-401a-a829-f90fcc658907
7662024-12-21T05:41:44.471ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672024-12-21T05:41:44.472ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682024-12-21T05:41:44.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10255253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59765 req_id = 53dd06be-6d3f-4018-936a-4f9453acda47 response_code = 204 uri = /omicron-zones
7692024-12-21T05:41:44.474ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702024-12-21T05:41:45.664ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 112.637446ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7712024-12-21T05:41:45.837ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722024-12-21T05:41:45.919ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7732024-12-21T05:41:46.016ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7742024-12-21T05:41:46.016ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7752024-12-21T05:41:46.048ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7762024-12-21T05:41:46.049ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7772024-12-21T05:41:46.049ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7782024-12-21T05:41:46.078ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: a125a34b-4f89-401a-a829-f90fcc658907 (service), filesystem_pool: Some(ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 07fb42e0-3eda-40fb-aaac-0446bc3c8a41 (service), filesystem_pool: Some(ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 6c1e198b-ea7d-436c-9b93-57bdb3386ca2 (service), filesystem_pool: Some(ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: f3620b5a-4324-4317-ab2e-b8693dff86cf (service), filesystem_pool: Some(ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: cf37ce28-9b67-4084-990b-bed4f394a3ad, kind: Service { id: f3620b5a-4324-4317-ab2e-b8693dff86cf }, name: Name("ntp-f3620b5a-4324-4317-ab2e-b8693dff86cf"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 52])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7792024-12-21T05:41:46.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59651
7802024-12-21T05:41:46.079ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812024-12-21T05:41:46.079ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822024-12-21T05:41:46.090ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832024-12-21T05:41:46.090ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842024-12-21T05:41:46.100ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852024-12-21T05:41:46.100ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862024-12-21T05:41:46.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7872024-12-21T05:41:46.110ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-zones.json file = common/src/ledger.rs:177
7882024-12-21T05:41:46.110ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-zones.json file = common/src/ledger.rs:177
7892024-12-21T05:41:46.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7902024-12-21T05:41:46.122ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7912024-12-21T05:41:46.154ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7922024-12-21T05:41:46.154ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7932024-12-21T05:41:46.154ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7942024-12-21T05:41:46.184ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 253, 52]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7952024-12-21T05:41:46.184ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7962024-12-21T05:41:46.184ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7972024-12-21T05:41:46.184ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7982024-12-21T05:41:46.184ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7992024-12-21T05:41:46.185ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8002024-12-21T05:41:46.208ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf file = illumos-utils/src/zone.rs:325
8012024-12-21T05:41:46.226ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf file = illumos-utils/src/zone.rs:363
8022024-12-21T05:41:46.421ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3440864123571746126 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8032024-12-21T05:41:46.422ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12650709719278949391 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8042024-12-21T05:41:46.842ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8052024-12-21T05:41:46.842ZINFOSledAgent (ServiceManager): Booting oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8062024-12-21T05:41:46.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf") failed: Property not found. retry in 53.729742ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8072024-12-21T05:41:47.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf") failed: Property not found. retry in 69.527335ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8082024-12-21T05:41:47.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf") failed: Property not found. retry in 293.125281ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8092024-12-21T05:41:47.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf") failed: Property not found. retry in 201.191561ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8102024-12-21T05:41:47.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf") failed: Property not found. retry in 959.02963ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8112024-12-21T05:41:48.196ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2809702307794696978 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8122024-12-21T05:41:48.197ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12099399048174492875 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8132024-12-21T05:41:48.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf") failed: Property not found. retry in 621.590265ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8142024-12-21T05:41:49.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf") failed: Property not found. retry in 1.128650619s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8152024-12-21T05:41:50.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf") failed: Property not found. retry in 968.221981ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8162024-12-21T05:41:51.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf") failed: Property not found. retry in 715.893544ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8172024-12-21T05:41:52.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf") failed: Property not found. retry in 743.974668ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8182024-12-21T05:41:52.839ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf
8192024-12-21T05:41:52.839ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8202024-12-21T05:41:52.839ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8212024-12-21T05:41:52.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6760878 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59651 req_id = d7483e47-dfbc-40f1-a125-148a070a1a2c response_code = 204 uri = /omicron-zones
8222024-12-21T05:41:52.841ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8232024-12-21T05:41:52.871ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8242024-12-21T05:41:52.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49934
8252024-12-21T05:41:52.882ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8262024-12-21T05:41:52.882ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 10865 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49934 req_id = c314517c-49c4-4118-b0b6-eda4796ab388 response_code = 500 uri = /timesync
8272024-12-21T05:41:52.885ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8282024-12-21T05:41:53.035ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8292024-12-21T05:41:53.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56323
8302024-12-21T05:41:54.228ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14532934029096680548 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8312024-12-21T05:41:54.389ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10688094340404264788 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8322024-12-21T05:41:54.474ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9862420489565481155 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8332024-12-21T05:41:56.424ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3440864123571746126 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8342024-12-21T05:41:56.424ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12650709719278949391 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8352024-12-21T05:41:57.043ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8362024-12-21T05:41:57.043ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56323 req_id = 7a3e2922-ef1c-4d44-ad48-ca1d424182de response_code = 500 uri = /timesync
8372024-12-21T05:41:57.045ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8382024-12-21T05:41:57.252ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8392024-12-21T05:41:57.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33673
8402024-12-21T05:41:57.261ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8412024-12-21T05:41:57.261ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8558 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33673 req_id = 787902ea-6191-4efd-bde4-6643295bcd55 response_code = 500 uri = /timesync
8422024-12-21T05:41:57.264ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8432024-12-21T05:41:57.390ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8442024-12-21T05:41:57.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41703
8452024-12-21T05:42:01.317ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f3620b5a-4324-4317-ab2e-b8693dff86cf': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8462024-12-21T05:42:01.317ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009629 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41703 req_id = 7fe39c2b-b8a1-4cb0-8979-b2b80a569ab7 response_code = 500 uri = /timesync
8472024-12-21T05:42:01.319ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2809702307794696978 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8482024-12-21T05:42:01.319ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12099399048174492875 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8492024-12-21T05:42:01.321ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 190.339848ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8502024-12-21T05:42:01.322ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8512024-12-21T05:42:01.598ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8522024-12-21T05:42:01.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60973
8532024-12-21T05:42:01.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8856 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60973 req_id = 79a7758a-8096-4c5f-aafa-488f15f38628 response_code = 200 uri = /timesync
8542024-12-21T05:42:01.610ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8552024-12-21T05:42:01.610ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8562024-12-21T05:42:01.885ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8572024-12-21T05:42:01.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54488
8582024-12-21T05:42:01.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54488 req_id = c5b7c6e8-e78c-4250-95e8-0e91d823be4e response_code = 200 uri = /timesync
8592024-12-21T05:42:01.896ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.076632023 } file = sled-agent/src/rack_setup/service.rs:743
8602024-12-21T05:42:01.896ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8612024-12-21T05:42:02.104ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8622024-12-21T05:42:02.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41610
8632024-12-21T05:42:02.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8593 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41610 req_id = e7131521-053c-4eed-8a6e-74101c8c92d0 response_code = 200 uri = /timesync
8642024-12-21T05:42:02.115ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.076036669 } file = sled-agent/src/rack_setup/service.rs:743
8652024-12-21T05:42:02.115ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8662024-12-21T05:42:02.441ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8672024-12-21T05:42:02.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45596
8682024-12-21T05:42:02.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8640 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45596 req_id = 7a6da514-58ba-4ba3-b41b-78cedf182a34 response_code = 200 uri = /timesync
8692024-12-21T05:42:02.452ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.075120986 } file = sled-agent/src/rack_setup/service.rs:743
8702024-12-21T05:42:02.452ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8712024-12-21T05:42:02.758ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4259928218985742516 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8722024-12-21T05:42:02.758ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7387962587820332628 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8732024-12-21T05:42:02.822ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8742024-12-21T05:42:02.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35039
8752024-12-21T05:42:02.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8457 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35039 req_id = 582a47e9-a266-4935-80cf-992b5b384a6e response_code = 200 uri = /timesync
8762024-12-21T05:42:02.832ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.07518062 } file = sled-agent/src/rack_setup/service.rs:743
8772024-12-21T05:42:02.832ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8782024-12-21T05:42:03.095ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8792024-12-21T05:42:03.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42106
8802024-12-21T05:42:03.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8760 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42106 req_id = a39c8698-9cf2-461f-8130-71b8e3c50fe2 response_code = 200 uri = /timesync
8812024-12-21T05:42:03.106ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.074438237 } file = sled-agent/src/rack_setup/service.rs:743
8822024-12-21T05:42:03.106ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8832024-12-21T05:42:03.479ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8842024-12-21T05:42:03.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56122
8852024-12-21T05:42:03.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56122 req_id = 60e773f9-94ea-4bc2-9715-83beab64dd40 response_code = 200 uri = /timesync
8862024-12-21T05:42:03.489ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.073395327 } file = sled-agent/src/rack_setup/service.rs:743
8872024-12-21T05:42:03.489ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8882024-12-21T05:42:04.141ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14532934029096680548 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8892024-12-21T05:42:04.277ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8902024-12-21T05:42:04.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39027
8912024-12-21T05:42:04.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8683 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39027 req_id = fbf728c5-1eb7-4cd5-a336-f2b0641b2a09 response_code = 200 uri = /timesync
8922024-12-21T05:42:04.287ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.07882078 } file = sled-agent/src/rack_setup/service.rs:743
8932024-12-21T05:42:04.287ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8942024-12-21T05:42:04.302ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10688094340404264788 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8952024-12-21T05:42:04.386ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9862420489565481155 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
8962024-12-21T05:42:05.323ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8972024-12-21T05:42:05.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57064
8982024-12-21T05:42:05.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7958 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57064 req_id = 6db6dc86-f688-4eba-aad7-ca60429ed77d response_code = 200 uri = /timesync
8992024-12-21T05:42:05.334ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.081827775 } file = sled-agent/src/rack_setup/service.rs:743
9002024-12-21T05:42:05.334ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9012024-12-21T05:42:06.330ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3440864123571746126 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
9022024-12-21T05:42:06.331ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12650709719278949391 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
9032024-12-21T05:42:06.584ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9042024-12-21T05:42:06.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64090
9052024-12-21T05:42:06.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9613 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64090 req_id = 950e8e2e-83ac-4870-811c-04de713c4ba8 response_code = 200 uri = /timesync
9062024-12-21T05:42:06.597ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861004517, ip_addr: 51.81.226.229, stratum: 3, ref_time: 1734759725.2808812, correction: -0.075539894 } file = sled-agent/src/rack_setup/service.rs:743
9072024-12-21T05:42:06.597ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9082024-12-21T05:42:07.042ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39251
9092024-12-21T05:42:07.042ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39251 req_id = e4c71768-6c10-485b-86c8-38b7ea2e2397 response_code = 200 uri = /baseboard
9102024-12-21T05:42:08.132ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9112024-12-21T05:42:08.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51402
9122024-12-21T05:42:08.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8934 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51402 req_id = 1dc9bf75-d6b1-4dec-ad18-be95a96b5162 response_code = 200 uri = /timesync
9132024-12-21T05:42:08.143ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2273734522, ip_addr: 135.134.111.122, stratum: 3, ref_time: 1734759726.8421948, correction: -0.060683906 } file = sled-agent/src/rack_setup/service.rs:743
9142024-12-21T05:42:08.143ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9152024-12-21T05:42:10.060ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9162024-12-21T05:42:10.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44795
9172024-12-21T05:42:10.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44795 req_id = 9a141209-4c28-46fd-86ba-3e2c1c9b92ef response_code = 200 uri = /timesync
9182024-12-21T05:42:10.071ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2273734522, ip_addr: 135.134.111.122, stratum: 3, ref_time: 1734759728.2154195, correction: -0.054907724 } file = sled-agent/src/rack_setup/service.rs:743
9192024-12-21T05:42:10.071ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9202024-12-21T05:42:11.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2809702307794696978 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
9212024-12-21T05:42:11.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12099399048174492875 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
9222024-12-21T05:42:11.921ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9232024-12-21T05:42:11.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39771
9242024-12-21T05:42:11.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21849 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39771 req_id = 6a48f77b-5e96-41b9-bb7f-7bf1ec40d39d response_code = 200 uri = /timesync
9252024-12-21T05:42:11.947ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2273734522, ip_addr: 135.134.111.122, stratum: 3, ref_time: 1734759730.884218, correction: -0.049956385 } file = sled-agent/src/rack_setup/service.rs:743
9262024-12-21T05:42:11.947ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
9272024-12-21T05:42:11.976ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: a125a34b-4f89-401a-a829-f90fcc658907 (service), filesystem_pool: Some(ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 07fb42e0-3eda-40fb-aaac-0446bc3c8a41 (service), filesystem_pool: Some(ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 6c1e198b-ea7d-436c-9b93-57bdb3386ca2 (service), filesystem_pool: Some(ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: f3620b5a-4324-4317-ab2e-b8693dff86cf (service), filesystem_pool: Some(ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: cf37ce28-9b67-4084-990b-bed4f394a3ad, kind: Service { id: f3620b5a-4324-4317-ab2e-b8693dff86cf }, name: Name("ntp-f3620b5a-4324-4317-ab2e-b8693dff86cf"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 52])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 690a39a1-19df-4390-8c75-a80ed2c0c2dc (service), filesystem_pool: Some(ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External } } } }, OmicronZoneConfig { id: d8f6a81f-83f6-4a4a-881a-167b6d5e907c (service), filesystem_pool: Some(ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External } } } }, OmicronZoneConfig { id: 35b19247-6fca-427b-a703-67b34f14cbe1 (service), filesystem_pool: Some(ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External } } } }, OmicronZoneConfig { id: 548568f2-a9ba-4da1-ab43-58c6b954623d (service), filesystem_pool: Some(ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External } } } }, OmicronZoneConfig { id: 4bead9cd-3083-4a69-9186-c47153623c4d (service), filesystem_pool: Some(ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9282024-12-21T05:42:11.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33419
9292024-12-21T05:42:11.977ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9302024-12-21T05:42:11.977ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9312024-12-21T05:42:11.988ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9322024-12-21T05:42:11.988ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9332024-12-21T05:42:11.999ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9342024-12-21T05:42:11.999ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9352024-12-21T05:42:12.008ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9362024-12-21T05:42:12.009ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9372024-12-21T05:42:12.018ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9382024-12-21T05:42:12.018ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9392024-12-21T05:42:12.028ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9402024-12-21T05:42:12.028ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9412024-12-21T05:42:12.038ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9422024-12-21T05:42:12.038ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Cockroach }, responder: ... }
9432024-12-21T05:42:12.047ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9442024-12-21T05:42:12.047ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9452024-12-21T05:42:12.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9462024-12-21T05:42:12.057ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-zones.json file = common/src/ledger.rs:177
9472024-12-21T05:42:12.057ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-zones.json file = common/src/ledger.rs:177
9482024-12-21T05:42:12.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9492024-12-21T05:42:12.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9502024-12-21T05:42:12.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9512024-12-21T05:42:12.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9522024-12-21T05:42:12.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9532024-12-21T05:42:12.142ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9542024-12-21T05:42:12.236ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1 file = illumos-utils/src/zone.rs:325
9552024-12-21T05:42:12.240ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc file = illumos-utils/src/zone.rs:325
9562024-12-21T05:42:12.245ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c file = illumos-utils/src/zone.rs:325
9572024-12-21T05:42:12.249ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d file = illumos-utils/src/zone.rs:325
9582024-12-21T05:42:12.254ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d file = illumos-utils/src/zone.rs:325
9592024-12-21T05:42:12.259ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1 file = illumos-utils/src/zone.rs:363
9602024-12-21T05:42:12.264ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc file = illumos-utils/src/zone.rs:363
9612024-12-21T05:42:12.268ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c file = illumos-utils/src/zone.rs:363
9622024-12-21T05:42:12.273ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d file = illumos-utils/src/zone.rs:363
9632024-12-21T05:42:12.277ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d file = illumos-utils/src/zone.rs:363
9642024-12-21T05:42:15.493ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4bead9cd-3083-4a69-9186-c47153623c4d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9652024-12-21T05:42:15.493ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
9662024-12-21T05:42:15.506ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d8f6a81f-83f6-4a4a-881a-167b6d5e907c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9672024-12-21T05:42:15.506ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
9682024-12-21T05:42:15.563ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='35b19247-6fca-427b-a703-67b34f14cbe1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9692024-12-21T05:42:15.563ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
9702024-12-21T05:42:15.577ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='548568f2-a9ba-4da1-ab43-58c6b954623d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9712024-12-21T05:42:15.577ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
9722024-12-21T05:42:15.597ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='690a39a1-19df-4390-8c75-a80ed2c0c2dc'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9732024-12-21T05:42:15.597ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
9742024-12-21T05:42:15.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 27.470297ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
9752024-12-21T05:42:15.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 60.808485ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
9762024-12-21T05:42:15.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 145.205738ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
9772024-12-21T05:42:15.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 140.862528ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
9782024-12-21T05:42:15.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 45.767005ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
9792024-12-21T05:42:16.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 263.579051ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
9802024-12-21T05:42:16.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 50.832003ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
9812024-12-21T05:42:16.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 288.242154ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
9822024-12-21T05:42:16.596ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 421.005989ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
9832024-12-21T05:42:16.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 85.629807ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
9842024-12-21T05:42:16.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 55.489654ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
9852024-12-21T05:42:16.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 573.888939ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
9862024-12-21T05:42:16.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 96.398157ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
9872024-12-21T05:42:16.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 169.774695ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
9882024-12-21T05:42:16.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 88.125989ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
9892024-12-21T05:42:16.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 525.193109ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
9902024-12-21T05:42:16.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 177.746335ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
9912024-12-21T05:42:16.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 208.021557ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
9922024-12-21T05:42:16.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 278.242811ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
9932024-12-21T05:42:17.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 236.257633ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
9942024-12-21T05:42:17.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 478.236307ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
9952024-12-21T05:42:17.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 626.969751ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
9962024-12-21T05:42:17.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 491.32614ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
9972024-12-21T05:42:17.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 518.465384ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
9982024-12-21T05:42:17.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 1.029606205s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
9992024-12-21T05:42:17.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 954.63774ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
10002024-12-21T05:42:17.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 1.069693692s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
10012024-12-21T05:42:17.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 1.084765248s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
10022024-12-21T05:42:17.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 749.470256ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
10032024-12-21T05:42:18.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 794.912928ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10042024-12-21T05:42:18.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 1.344730234s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
10052024-12-21T05:42:18.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 1.287014343s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
10062024-12-21T05:42:18.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 1.011349796s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
10072024-12-21T05:42:18.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 1.217847042s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
10082024-12-21T05:42:19.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 613.082936ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10092024-12-21T05:42:19.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 549.196098ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10102024-12-21T05:42:19.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 1.083946782s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
10112024-12-21T05:42:19.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 1.157339678s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
10122024-12-21T05:42:19.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 1.071864623s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
10132024-12-21T05:42:20.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 1.306774875s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
10142024-12-21T05:42:20.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 1.045160889s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10152024-12-21T05:42:20.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 778.660479ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
10162024-12-21T05:42:20.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 722.8174ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
10172024-12-21T05:42:21.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 765.723477ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
10182024-12-21T05:42:21.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 1.023940901s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10192024-12-21T05:42:21.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 727.908372ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
10202024-12-21T05:42:21.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 1.102045185s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
10212024-12-21T05:42:21.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 1.089914272s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
10222024-12-21T05:42:21.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 1.483552265s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
10232024-12-21T05:42:22.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 1.484578337s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
10242024-12-21T05:42:22.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 1.304684747s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10252024-12-21T05:42:22.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 1.272900996s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
10262024-12-21T05:42:22.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 1.215189716s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
10272024-12-21T05:42:23.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 1.369925779s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
10282024-12-21T05:42:23.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 1.098997197s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
10292024-12-21T05:42:23.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 527.158622ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10302024-12-21T05:42:24.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 1.261728342s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
10312024-12-21T05:42:24.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 1.041122799s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
10322024-12-21T05:42:24.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 871.85675ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10332024-12-21T05:42:24.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 940.757028ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
10342024-12-21T05:42:24.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 539.044754ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
10352024-12-21T05:42:25.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 772.437858ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
10362024-12-21T05:42:25.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 1.291472481s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10372024-12-21T05:42:25.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 1.169111362s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
10382024-12-21T05:42:25.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 653.562732ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
10392024-12-21T05:42:25.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 1.006336036s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
10402024-12-21T05:42:25.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 597.493837ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
10412024-12-21T05:42:26.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 1.205576576s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
10422024-12-21T05:42:26.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 519.649327ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10432024-12-21T05:42:26.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 1.029865734s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
10442024-12-21T05:42:26.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1") failed: Property not found. retry in 1.315230922s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
10452024-12-21T05:42:26.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c") failed: Property not found. retry in 1.170165113s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
10462024-12-21T05:42:26.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d") failed: Property not found. retry in 712.173748ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10472024-12-21T05:42:27.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d") failed: Property not found. retry in 592.602818ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
10482024-12-21T05:42:27.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc") failed: Property not found. retry in 1.094120392s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
10492024-12-21T05:42:28.677ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1
10502024-12-21T05:42:28.677ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_690a39a1-19df-4390-8c75-a80ed2c0c2dc
10512024-12-21T05:42:28.677ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_d8f6a81f-83f6-4a4a-881a-167b6d5e907c
10522024-12-21T05:42:28.677ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_548568f2-a9ba-4da1-ab43-58c6b954623d
10532024-12-21T05:42:28.677ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_4bead9cd-3083-4a69-9186-c47153623c4d
10542024-12-21T05:42:28.677ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10552024-12-21T05:42:28.678ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10562024-12-21T05:42:28.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16746742 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33419 req_id = 8f59caeb-79cc-4e1a-a84e-622e666b7632 response_code = 204 uri = /omicron-zones
10572024-12-21T05:42:28.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61844
10582024-12-21T05:42:28.753ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 35317 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61844 req_id = d9f78ae1-1191-4c04-8b76-bf744fd77f79 response_code = 500 uri = /cockroachdb
10592024-12-21T05:42:28.753ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d9f78ae1-1191-4c04-8b76-bf744fd77f79", "content-length": "124", "date": "Sat, 21 Dec 2024 05:42:28 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d9f78ae1-1191-4c04-8b76-bf744fd77f79" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 113.187146ms
10602024-12-21T05:42:28.896ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28390 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61844 req_id = b219d48a-014f-42f7-ba10-3dfd53995340 response_code = 500 uri = /cockroachdb
10612024-12-21T05:42:28.896ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b219d48a-014f-42f7-ba10-3dfd53995340", "content-length": "124", "date": "Sat, 21 Dec 2024 05:42:28 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b219d48a-014f-42f7-ba10-3dfd53995340" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 124.714865ms
10622024-12-21T05:42:29.053ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 31084 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61844 req_id = 7a8436fc-fb8b-40fa-aed0-263352643de2 response_code = 500 uri = /cockroachdb
10632024-12-21T05:42:29.053ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7a8436fc-fb8b-40fa-aed0-263352643de2", "content-length": "124", "date": "Sat, 21 Dec 2024 05:42:28 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7a8436fc-fb8b-40fa-aed0-263352643de2" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 123.815069ms
10642024-12-21T05:42:29.205ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27929 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61844 req_id = 2225efb7-30ac-4b20-a00c-34e25fb97b1f response_code = 500 uri = /cockroachdb
10652024-12-21T05:42:29.206ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2225efb7-30ac-4b20-a00c-34e25fb97b1f", "content-length": "124", "date": "Sat, 21 Dec 2024 05:42:28 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2225efb7-30ac-4b20-a00c-34e25fb97b1f" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 238.464026ms
10662024-12-21T05:42:29.471ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_35b19247-6fca-427b-a703-67b34f14cbe1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25724 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61844 req_id = 65157864-b4e6-4dd1-a4c1-23c666d1d406 response_code = 500 uri = /cockroachdb
10672024-12-21T05:42:29.471ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "65157864-b4e6-4dd1-a4c1-23c666d1d406", "content-length": "124", "date": "Sat, 21 Dec 2024 05:42:28 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "65157864-b4e6-4dd1-a4c1-23c666d1d406" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 195.869607ms
10682024-12-21T05:42:29.704ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3758
10692024-12-21T05:42:38.025ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
10702024-12-21T05:42:41.663ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
10712024-12-21T05:42:41.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11996324 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:61844 req_id = d4600382-cd44-4d0d-800f-828658ee1b3f response_code = 204 uri = /cockroachdb
10722024-12-21T05:42:41.666ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64505
10732024-12-21T05:42:41.667ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 744 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64505 req_id = be1c66e4-12b7-4062-ad82-74c31ea45b16 response_code = 200 uri = /baseboard
10742024-12-21T05:42:41.674ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 532.128874ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
10752024-12-21T05:42:41.713ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: a125a34b-4f89-401a-a829-f90fcc658907 (service), filesystem_pool: Some(ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 07fb42e0-3eda-40fb-aaac-0446bc3c8a41 (service), filesystem_pool: Some(ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 6c1e198b-ea7d-436c-9b93-57bdb3386ca2 (service), filesystem_pool: Some(ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: f3620b5a-4324-4317-ab2e-b8693dff86cf (service), filesystem_pool: Some(ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: cf37ce28-9b67-4084-990b-bed4f394a3ad, kind: Service { id: f3620b5a-4324-4317-ab2e-b8693dff86cf }, name: Name("ntp-f3620b5a-4324-4317-ab2e-b8693dff86cf"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 52])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 690a39a1-19df-4390-8c75-a80ed2c0c2dc (service), filesystem_pool: Some(ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External } } } }, OmicronZoneConfig { id: d8f6a81f-83f6-4a4a-881a-167b6d5e907c (service), filesystem_pool: Some(ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External } } } }, OmicronZoneConfig { id: 35b19247-6fca-427b-a703-67b34f14cbe1 (service), filesystem_pool: Some(ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External } } } }, OmicronZoneConfig { id: 548568f2-a9ba-4da1-ab43-58c6b954623d (service), filesystem_pool: Some(ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External } } } }, OmicronZoneConfig { id: 4bead9cd-3083-4a69-9186-c47153623c4d (service), filesystem_pool: Some(ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External } } } }, OmicronZoneConfig { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa (service), filesystem_pool: Some(ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 57b78e12-2ea9-463d-a689-565344dffa73, kind: Service { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa }, name: Name("external-dns-284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 59])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 (service), filesystem_pool: Some(ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 7068213c-a7cd-4f1b-b697-368276e5ea37, kind: Service { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 }, name: Name("external-dns-5f5da623-23f2-4e2f-b423-7097e8481e49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 (service), filesystem_pool: Some(ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 3a266615-9b66-4a87-93bc-6f160dec5481, kind: Service { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 }, name: Name("nexus-4c5d0e65-66c8-4b42-9538-d497e5b523f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: b381127d-ac24-4ced-abe2-28a1272fd710 (service), filesystem_pool: Some(ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 2186fc88-ccae-445f-be44-94dc147f97b5, kind: Service { id: b381127d-ac24-4ced-abe2-28a1272fd710 }, name: Name("nexus-b381127d-ac24-4ced-abe2-28a1272fd710"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de (service), filesystem_pool: Some(ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 08ad27df-342d-495e-a4af-9b1bd7ef97af, kind: Service { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de }, name: Name("nexus-ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 5539f2b1-1861-4dbb-974a-1247914c9a95 (service), filesystem_pool: Some(ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 1877e20e-fbcc-4240-a6e8-744f4889600f (service), filesystem_pool: Some(ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8afe77a5-36b9-444f-a9d2-0b12478fdbb9 (service), filesystem_pool: Some(ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 0b597c3c-305d-4d4f-ad19-4f4d978040c6 (service), filesystem_pool: Some(ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 1d62b24a-7296-4ee0-a63f-68a2228d07b7 (service), filesystem_pool: Some(ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 3e936875-2f74-4e20-99be-0527df1a8978 (service), filesystem_pool: Some(ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8e83eb15-36d2-46e0-ba92-fc84d84438b0 (service), filesystem_pool: Some(ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External } } } }, OmicronZoneConfig { id: cd5047d1-3ca5-44c4-a116-b6c9b040e114 (service), filesystem_pool: Some(ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External } } } }, OmicronZoneConfig { id: 58a3e4e5-2240-49f1-94f3-64b58498ae89 (service), filesystem_pool: Some(ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External } } } }, OmicronZoneConfig { id: 4d89cf30-77fc-43dd-b352-0e05c3e104da (service), filesystem_pool: Some(ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External } } } }, OmicronZoneConfig { id: 239d37ca-8dc0-40e0-9102-dc9d1846f5c8 (service), filesystem_pool: Some(ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External } } } }, OmicronZoneConfig { id: aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8 (service), filesystem_pool: Some(ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9007028a-d045-423f-bb8c-b25a29015153 (service), filesystem_pool: Some(ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External } } } }, OmicronZoneConfig { id: a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3 (service), filesystem_pool: Some(ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10762024-12-21T05:42:41.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51963
10772024-12-21T05:42:41.715ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10782024-12-21T05:42:41.716ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10792024-12-21T05:42:41.729ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10802024-12-21T05:42:41.729ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10812024-12-21T05:42:41.740ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10822024-12-21T05:42:41.740ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10832024-12-21T05:42:41.751ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10842024-12-21T05:42:41.751ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10852024-12-21T05:42:41.761ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10862024-12-21T05:42:41.761ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10872024-12-21T05:42:41.771ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10882024-12-21T05:42:41.771ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10892024-12-21T05:42:41.781ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10902024-12-21T05:42:41.781ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10912024-12-21T05:42:41.790ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10922024-12-21T05:42:41.790ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10932024-12-21T05:42:41.800ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10942024-12-21T05:42:41.800ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10952024-12-21T05:42:41.810ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10962024-12-21T05:42:41.810ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10972024-12-21T05:42:41.821ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10982024-12-21T05:42:41.821ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10992024-12-21T05:42:41.832ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11002024-12-21T05:42:41.832ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, kind: Crucible }, responder: ... }
11012024-12-21T05:42:41.842ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11022024-12-21T05:42:41.842ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, kind: Crucible }, responder: ... }
11032024-12-21T05:42:41.852ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11042024-12-21T05:42:41.852ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, kind: Crucible }, responder: ... }
11052024-12-21T05:42:41.862ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11062024-12-21T05:42:41.862ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, kind: Crucible }, responder: ... }
11072024-12-21T05:42:41.871ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11082024-12-21T05:42:41.871ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, kind: Crucible }, responder: ... }
11092024-12-21T05:42:41.880ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11102024-12-21T05:42:41.881ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, kind: Crucible }, responder: ... }
11112024-12-21T05:42:41.890ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11122024-12-21T05:42:41.891ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, kind: Crucible }, responder: ... }
11132024-12-21T05:42:41.900ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11142024-12-21T05:42:41.900ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, kind: Crucible }, responder: ... }
11152024-12-21T05:42:41.911ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11162024-12-21T05:42:41.911ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, kind: Crucible }, responder: ... }
11172024-12-21T05:42:41.920ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11182024-12-21T05:42:41.920ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-zones.json file = common/src/ledger.rs:177
11192024-12-21T05:42:41.921ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-zones.json file = common/src/ledger.rs:177
11202024-12-21T05:42:41.921ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11212024-12-21T05:42:42.053ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11222024-12-21T05:42:42.080ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11232024-12-21T05:42:42.080ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11242024-12-21T05:42:42.082ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11252024-12-21T05:42:42.095ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11262024-12-21T05:42:42.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11272024-12-21T05:42:42.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11282024-12-21T05:42:42.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11292024-12-21T05:42:42.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11302024-12-21T05:42:42.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11312024-12-21T05:42:42.150ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11322024-12-21T05:42:42.315ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11332024-12-21T05:42:42.316ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11342024-12-21T05:42:42.368ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11352024-12-21T05:42:42.368ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11362024-12-21T05:42:42.368ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11372024-12-21T05:42:42.368ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11382024-12-21T05:42:42.368ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11392024-12-21T05:42:42.368ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11402024-12-21T05:42:42.369ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153 file = illumos-utils/src/zone.rs:325
11412024-12-21T05:42:42.374ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9 file = illumos-utils/src/zone.rs:325
11422024-12-21T05:42:42.379ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7 file = illumos-utils/src/zone.rs:325
11432024-12-21T05:42:42.385ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0 file = illumos-utils/src/zone.rs:325
11442024-12-21T05:42:42.390ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978 file = illumos-utils/src/zone.rs:325
11452024-12-21T05:42:42.395ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114 file = illumos-utils/src/zone.rs:325
11462024-12-21T05:42:42.400ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8 file = illumos-utils/src/zone.rs:325
11472024-12-21T05:42:42.547ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153 file = illumos-utils/src/zone.rs:363
11482024-12-21T05:42:42.552ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9 file = illumos-utils/src/zone.rs:363
11492024-12-21T05:42:42.557ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7 file = illumos-utils/src/zone.rs:363
11502024-12-21T05:42:42.562ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0 file = illumos-utils/src/zone.rs:363
11512024-12-21T05:42:42.567ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978 file = illumos-utils/src/zone.rs:363
11522024-12-21T05:42:42.572ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114 file = illumos-utils/src/zone.rs:363
11532024-12-21T05:42:42.578ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8 file = illumos-utils/src/zone.rs:363
11542024-12-21T05:42:42.583ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da file = illumos-utils/src/zone.rs:325
11552024-12-21T05:42:42.590ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6 file = illumos-utils/src/zone.rs:325
11562024-12-21T05:42:42.595ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95 file = illumos-utils/src/zone.rs:325
11572024-12-21T05:42:42.602ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f file = illumos-utils/src/zone.rs:325
11582024-12-21T05:42:42.609ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89 file = illumos-utils/src/zone.rs:325
11592024-12-21T05:42:42.617ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8 file = illumos-utils/src/zone.rs:325
11602024-12-21T05:42:42.624ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3 file = illumos-utils/src/zone.rs:325
11612024-12-21T05:42:42.634ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da file = illumos-utils/src/zone.rs:363
11622024-12-21T05:42:42.641ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6 file = illumos-utils/src/zone.rs:363
11632024-12-21T05:42:42.648ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95 file = illumos-utils/src/zone.rs:363
11642024-12-21T05:42:42.654ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f file = illumos-utils/src/zone.rs:363
11652024-12-21T05:42:42.662ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89 file = illumos-utils/src/zone.rs:363
11662024-12-21T05:42:42.674ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8 file = illumos-utils/src/zone.rs:363
11672024-12-21T05:42:42.686ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3 file = illumos-utils/src/zone.rs:363
11682024-12-21T05:42:42.866ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11692024-12-21T05:42:42.977ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11702024-12-21T05:42:43.070ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11712024-12-21T05:42:43.171ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11722024-12-21T05:42:43.264ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11732024-12-21T05:42:43.275ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11742024-12-21T05:42:43.276ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11752024-12-21T05:42:43.329ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 222, 100]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11762024-12-21T05:42:43.329ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11772024-12-21T05:42:43.331ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11782024-12-21T05:42:43.331ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11792024-12-21T05:42:43.388ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 212, 3]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11802024-12-21T05:42:43.388ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11812024-12-21T05:42:43.399ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11822024-12-21T05:42:43.399ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11832024-12-21T05:42:43.451ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 171, 87]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11842024-12-21T05:42:43.451ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11852024-12-21T05:42:43.453ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11862024-12-21T05:42:43.453ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11872024-12-21T05:42:43.509ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 167, 59]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11882024-12-21T05:42:43.509ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11892024-12-21T05:42:43.511ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11902024-12-21T05:42:43.511ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11912024-12-21T05:42:43.573ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 151, 102]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11922024-12-21T05:42:43.573ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11932024-12-21T05:42:43.583ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11942024-12-21T05:42:43.583ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11952024-12-21T05:42:43.584ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11962024-12-21T05:42:43.584ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11972024-12-21T05:42:43.584ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11982024-12-21T05:42:43.584ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11992024-12-21T05:42:43.584ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12002024-12-21T05:42:43.584ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12012024-12-21T05:42:43.585ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12022024-12-21T05:42:43.585ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12032024-12-21T05:42:43.598ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12042024-12-21T05:42:43.601ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12052024-12-21T05:42:43.648ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12062024-12-21T05:42:43.654ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12072024-12-21T05:42:43.657ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12082024-12-21T05:42:43.658ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12092024-12-21T05:42:43.658ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12102024-12-21T05:42:43.660ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12112024-12-21T05:42:43.664ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12122024-12-21T05:42:43.664ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12132024-12-21T05:42:43.834ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9 file = illumos-utils/src/zone.rs:325
12142024-12-21T05:42:43.845ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de file = illumos-utils/src/zone.rs:325
12152024-12-21T05:42:43.859ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49 file = illumos-utils/src/zone.rs:325
12162024-12-21T05:42:43.887ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710 file = illumos-utils/src/zone.rs:325
12172024-12-21T05:42:43.903ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa file = illumos-utils/src/zone.rs:325
12182024-12-21T05:42:43.921ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9 file = illumos-utils/src/zone.rs:363
12192024-12-21T05:42:43.951ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de file = illumos-utils/src/zone.rs:363
12202024-12-21T05:42:43.997ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49 file = illumos-utils/src/zone.rs:363
12212024-12-21T05:42:44.023ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710 file = illumos-utils/src/zone.rs:363
12222024-12-21T05:42:44.039ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa file = illumos-utils/src/zone.rs:363
12232024-12-21T05:42:48.192ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12242024-12-21T05:42:48.194ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12252024-12-21T05:42:48.194ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
12262024-12-21T05:42:48.214ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12272024-12-21T05:42:48.214ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
12282024-12-21T05:42:48.230ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
12292024-12-21T05:42:48.346ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3351d590-858e-45b6-91ff-51f0d9e17995/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='455253ec-7384-4d25-b46d-71fb4853c77d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12302024-12-21T05:42:48.347ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
12312024-12-21T05:42:48.354ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7912c084-27e1-426d-a3ef-7d0f642d9382/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0461697c-7015-432e-92fc-113cc6c72a16'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12322024-12-21T05:42:48.363ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_871c983c-3586-410a-849e-2f5b0cbe8e62/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cfc08d31-2d37-4865-837f-ff535c726e50'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12332024-12-21T05:42:48.364ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='778db10c-c3c0-422a-8023-babc7ec3392f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12342024-12-21T05:42:48.364ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='805d873f-969c-410a-a4c2-7cbd650645e1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12352024-12-21T05:42:48.365ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b8bab2c7-1ccf-420c-a09f-1e1fe43832f4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12362024-12-21T05:42:48.365ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bdc109cb-6714-4a1e-b428-249e5a48bf6d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12372024-12-21T05:42:48.365ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fa625e73-0c39-487d-9929-b234b9ea83f9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ed6d4ade-e45a-4e72-a9d8-843d5a31a0d1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12382024-12-21T05:42:48.365ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c6a4fa58-4039-4877-b150-734515213172'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12392024-12-21T05:42:48.366ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
12402024-12-21T05:42:48.377ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
12412024-12-21T05:42:48.385ZINFOSledAgent (ServiceManager): Booting oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
12422024-12-21T05:42:48.394ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
12432024-12-21T05:42:48.402ZINFOSledAgent (ServiceManager): Booting oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
12442024-12-21T05:42:48.410ZINFOSledAgent (ServiceManager): Booting oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
12452024-12-21T05:42:48.419ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
12462024-12-21T05:42:48.427ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
12472024-12-21T05:42:48.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 34.214022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
12482024-12-21T05:42:48.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 74.586112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
12492024-12-21T05:42:48.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 74.095213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
12502024-12-21T05:42:48.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 40.936282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
12512024-12-21T05:42:48.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 25.786883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
12522024-12-21T05:42:48.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 54.274708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
12532024-12-21T05:42:56.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 38.62503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
12542024-12-21T05:42:56.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 31.984531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
12552024-12-21T05:42:56.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 40.501808ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
12562024-12-21T05:42:56.538ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='5539f2b1-1861-4dbb-974a-1247914c9a95'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12572024-12-21T05:42:56.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 46.509564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
12582024-12-21T05:42:56.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 38.640858ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
12592024-12-21T05:42:56.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 51.068946ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
12602024-12-21T05:42:56.818ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
12612024-12-21T05:42:57.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 68.124647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
12622024-12-21T05:42:57.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 97.821713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
12632024-12-21T05:42:58.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 101.355354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
12642024-12-21T05:42:58.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 101.832955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
12652024-12-21T05:42:58.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 79.437417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
12662024-12-21T05:42:58.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 72.302889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
12672024-12-21T05:42:59.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 102.826388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
12682024-12-21T05:42:59.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 123.052329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
12692024-12-21T05:42:59.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 135.804481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
12702024-12-21T05:42:59.146ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.089185092s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
12712024-12-21T05:42:59.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 109.207567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
12722024-12-21T05:42:59.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 101.958518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
12732024-12-21T05:42:59.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 74.615418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
12742024-12-21T05:42:59.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 41.536785ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
12752024-12-21T05:42:59.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 113.37385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
12762024-12-21T05:42:59.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 224.347871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
12772024-12-21T05:42:59.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 105.293052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
12782024-12-21T05:42:59.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 124.378512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
12792024-12-21T05:42:59.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 260.94659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
12802024-12-21T05:42:59.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 171.822683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
12812024-12-21T05:42:59.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 251.148248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
12822024-12-21T05:42:59.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 202.454741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
12832024-12-21T05:42:59.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 167.161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
12842024-12-21T05:42:59.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 150.035672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
12852024-12-21T05:42:59.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 100.605638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
12862024-12-21T05:42:59.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 148.375062ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
12872024-12-21T05:42:59.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 143.560475ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
12882024-12-21T05:42:59.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 206.208942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
12892024-12-21T05:42:59.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 228.716244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
12902024-12-21T05:42:59.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 305.172553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
12912024-12-21T05:42:59.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 286.001071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
12922024-12-21T05:42:59.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 533.048336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
12932024-12-21T05:42:59.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 211.95948ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
12942024-12-21T05:42:59.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 537.189915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
12952024-12-21T05:42:59.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 581.433983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
12962024-12-21T05:42:59.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 534.148374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
12972024-12-21T05:42:59.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 262.721475ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
12982024-12-21T05:42:59.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 247.423889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
12992024-12-21T05:42:59.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 524.317132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
13002024-12-21T05:42:59.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 452.1969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
13012024-12-21T05:42:59.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 947.535568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
13022024-12-21T05:42:59.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 1.190586003s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
13032024-12-21T05:42:59.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 658.797975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
13042024-12-21T05:42:59.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 1.137026803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
13052024-12-21T05:42:59.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 731.662872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
13062024-12-21T05:42:59.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.124832689s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
13072024-12-21T05:42:59.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 582.877861ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
13082024-12-21T05:42:59.871ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13092024-12-21T05:42:59.872ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
13102024-12-21T05:43:00.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 569.373246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
13112024-12-21T05:43:00.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 1.115250859s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
13122024-12-21T05:43:00.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 483.321581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
13132024-12-21T05:43:00.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 1.182463852s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
13142024-12-21T05:43:00.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 511.475393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
13152024-12-21T05:43:00.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 694.942361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
13162024-12-21T05:43:00.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 28.24374ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
13172024-12-21T05:43:00.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 96.181509ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
13182024-12-21T05:43:00.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 1.10269682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
13192024-12-21T05:43:00.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.270309915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
13202024-12-21T05:43:00.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 1.119194584s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
13212024-12-21T05:43:00.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 1.472288004s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
13222024-12-21T05:43:00.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.342848311s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
13232024-12-21T05:43:00.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 582.582984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
13242024-12-21T05:43:00.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 888.415708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
13252024-12-21T05:43:00.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 158.33182ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
13262024-12-21T05:43:00.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 501.727503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
13272024-12-21T05:43:00.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 620.16878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
13282024-12-21T05:43:00.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 238.865081ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
13292024-12-21T05:43:00.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 550.394426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
13302024-12-21T05:43:00.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 540.388254ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
13312024-12-21T05:43:01.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.194290318s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
13322024-12-21T05:43:01.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 920.707979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
13332024-12-21T05:43:01.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 740.539971ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
13342024-12-21T05:43:01.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 650.643637ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
13352024-12-21T05:43:01.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 1.074689227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
13362024-12-21T05:43:01.447ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13372024-12-21T05:43:01.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 652.082205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
13382024-12-21T05:43:01.571ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
13392024-12-21T05:43:01.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 628.580405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
13402024-12-21T05:43:01.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 881.744094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
13412024-12-21T05:43:01.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 909.559539ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
13422024-12-21T05:43:01.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 1.336691617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
13432024-12-21T05:43:01.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 608.596356ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
13442024-12-21T05:43:01.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 629.561508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
13452024-12-21T05:43:01.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 553.278765ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
13462024-12-21T05:43:01.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 29.750114ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
13472024-12-21T05:43:01.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 106.233592ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
13482024-12-21T05:43:02.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.194281785s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
13492024-12-21T05:43:02.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.414878945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
13502024-12-21T05:43:02.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 595.642757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
13512024-12-21T05:43:02.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 291.180001ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
13522024-12-21T05:43:02.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 704.079481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
13532024-12-21T05:43:02.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 1.023572665s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
13542024-12-21T05:43:02.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 688.583546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
13552024-12-21T05:43:02.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.357021139s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
13562024-12-21T05:43:02.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 912.164083ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
13572024-12-21T05:43:02.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 563.522136ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
13582024-12-21T05:43:02.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 517.740121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
13592024-12-21T05:43:02.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 1.472936927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
13602024-12-21T05:43:02.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 919.667829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
13612024-12-21T05:43:02.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.347765064s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
13622024-12-21T05:43:02.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 1.319326555s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
13632024-12-21T05:43:02.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 778.041881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
13642024-12-21T05:43:02.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 1.184826074s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
13652024-12-21T05:43:02.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 1.410247162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
13662024-12-21T05:43:02.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 1.130025503s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
13672024-12-21T05:43:02.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 551.618413ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
13682024-12-21T05:43:03.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 671.933556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
13692024-12-21T05:43:03.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.454580674s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
13702024-12-21T05:43:03.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 513.971409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
13712024-12-21T05:43:03.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 694.612866ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
13722024-12-21T05:43:03.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 787.756492ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
13732024-12-21T05:43:03.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 821.155671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
13742024-12-21T05:43:03.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.1924617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
13752024-12-21T05:43:03.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 901.508162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
13762024-12-21T05:43:03.596ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13772024-12-21T05:43:03.596ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13782024-12-21T05:43:03.597ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13792024-12-21T05:43:03.597ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
13802024-12-21T05:43:03.601ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
13812024-12-21T05:43:03.605ZINFOSledAgent (ServiceManager): Booting oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
13822024-12-21T05:43:03.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 775.990377ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
13832024-12-21T05:43:03.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 44.113839ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
13842024-12-21T05:43:03.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 65.70091ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
13852024-12-21T05:43:03.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 66.980212ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
13862024-12-21T05:43:03.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 526.914818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
13872024-12-21T05:43:03.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 746.601464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
13882024-12-21T05:43:03.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 59.385761ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
13892024-12-21T05:43:03.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 78.247546ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
13902024-12-21T05:43:03.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 68.601197ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
13912024-12-21T05:43:03.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 273.87635ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
13922024-12-21T05:43:03.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 153.385858ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
13932024-12-21T05:43:03.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.378601928s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
13942024-12-21T05:43:03.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 221.859625ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
13952024-12-21T05:43:03.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 591.676148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
13962024-12-21T05:43:03.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 563.43607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
13972024-12-21T05:43:04.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 872.911518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
13982024-12-21T05:43:04.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 592.233808ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
13992024-12-21T05:43:04.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 1.497820461s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
14002024-12-21T05:43:04.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 594.245452ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
14012024-12-21T05:43:04.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 204.248258ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
14022024-12-21T05:43:04.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 942.082753ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
14032024-12-21T05:43:04.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 547.084961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
14042024-12-21T05:43:04.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 1.241828214s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
14052024-12-21T05:43:04.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 1.316235664s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
14062024-12-21T05:43:04.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 995.551426ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
14072024-12-21T05:43:04.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 1.224142589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
14082024-12-21T05:43:04.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 627.897185ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
14092024-12-21T05:43:04.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.045088312s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
14102024-12-21T05:43:04.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 643.356989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
14112024-12-21T05:43:04.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 688.60002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
14122024-12-21T05:43:04.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 514.423421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
14132024-12-21T05:43:04.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 863.639947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
14142024-12-21T05:43:04.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 694.665576ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
14152024-12-21T05:43:04.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 909.278674ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
14162024-12-21T05:43:04.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 799.27296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
14172024-12-21T05:43:04.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 1.128129323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
14182024-12-21T05:43:04.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 1.228032407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
14192024-12-21T05:43:05.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 879.737023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
14202024-12-21T05:43:05.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 500.377814ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
14212024-12-21T05:43:05.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 1.115866787s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
14222024-12-21T05:43:05.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 1.015220214s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
14232024-12-21T05:43:05.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 717.162152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
14242024-12-21T05:43:05.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 569.242068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
14252024-12-21T05:43:05.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 585.690596ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
14262024-12-21T05:43:05.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 1.007939774s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
14272024-12-21T05:43:05.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 980.503113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
14282024-12-21T05:43:05.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.4383939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
14292024-12-21T05:43:05.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.287055359s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
14302024-12-21T05:43:05.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 1.46834986s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
14312024-12-21T05:43:05.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 1.377948132s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
14322024-12-21T05:43:05.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 545.179989ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
14332024-12-21T05:43:05.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 524.900751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
14342024-12-21T05:43:05.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 627.21764ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
14352024-12-21T05:43:05.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 1.174560419s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
14362024-12-21T05:43:05.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.170973351s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
14372024-12-21T05:43:05.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 827.217124ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
14382024-12-21T05:43:05.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 582.787148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
14392024-12-21T05:43:06.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 1.038669622s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
14402024-12-21T05:43:06.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 759.711415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
14412024-12-21T05:43:06.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 685.994451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
14422024-12-21T05:43:06.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.102450935s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
14432024-12-21T05:43:06.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 688.265409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
14442024-12-21T05:43:06.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 1.333522875s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
14452024-12-21T05:43:06.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 734.077141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
14462024-12-21T05:43:06.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 918.35761ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
14472024-12-21T05:43:06.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 899.146447ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
14482024-12-21T05:43:06.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 694.699366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
14492024-12-21T05:43:06.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 1.257599203s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
14502024-12-21T05:43:06.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 1.096554314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
14512024-12-21T05:43:06.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 667.854327ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
14522024-12-21T05:43:06.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 588.339936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
14532024-12-21T05:43:06.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 637.363848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
14542024-12-21T05:43:06.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 612.944771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
14552024-12-21T05:43:06.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 1.494336087s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
14562024-12-21T05:43:07.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 511.113733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
14572024-12-21T05:43:07.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 564.936006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
14582024-12-21T05:43:07.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 850.180231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
14592024-12-21T05:43:07.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.325839181s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
14602024-12-21T05:43:07.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 751.153512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
14612024-12-21T05:43:07.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 613.28721ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
14622024-12-21T05:43:07.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.433530818s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
14632024-12-21T05:43:07.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 1.072958515s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
14642024-12-21T05:43:07.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 900.319517ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
14652024-12-21T05:43:07.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 754.535595ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
14662024-12-21T05:43:07.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.006088098s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
14672024-12-21T05:43:07.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 640.346646ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
14682024-12-21T05:43:07.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 1.480801702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
14692024-12-21T05:43:07.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 765.615523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
14702024-12-21T05:43:07.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.421582936s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
14712024-12-21T05:43:07.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 533.623779ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
14722024-12-21T05:43:07.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 734.294085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
14732024-12-21T05:43:07.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 1.067694892s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
14742024-12-21T05:43:07.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 720.49543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
14752024-12-21T05:43:07.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 1.161554468s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
14762024-12-21T05:43:07.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 988.237569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
14772024-12-21T05:43:07.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 1.499618238s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
14782024-12-21T05:43:08.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.0770758s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
14792024-12-21T05:43:08.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 754.414652ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
14802024-12-21T05:43:08.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 1.463642212s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
14812024-12-21T05:43:08.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 1.410037109s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
14822024-12-21T05:43:08.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 739.008871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
14832024-12-21T05:43:08.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 1.325334955s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
14842024-12-21T05:43:08.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 1.180202505s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
14852024-12-21T05:43:08.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 902.495019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
14862024-12-21T05:43:08.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 805.418589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
14872024-12-21T05:43:08.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.238237938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
14882024-12-21T05:43:08.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 1.015145215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
14892024-12-21T05:43:08.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.469758425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
14902024-12-21T05:43:08.776ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14912024-12-21T05:43:08.777ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
14922024-12-21T05:43:08.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 1.24688447s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
14932024-12-21T05:43:08.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 1.312582456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
14942024-12-21T05:43:08.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 1.339355402s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
14952024-12-21T05:43:08.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 53.500865ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
14962024-12-21T05:43:09.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 67.012599ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
14972024-12-21T05:43:09.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.258596606s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
14982024-12-21T05:43:09.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 538.724638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
14992024-12-21T05:43:09.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 1.300468599s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
15002024-12-21T05:43:09.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 980.497815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
15012024-12-21T05:43:09.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 295.248863ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
15022024-12-21T05:43:09.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 958.645089ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
15032024-12-21T05:43:09.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 1.460754933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
15042024-12-21T05:43:09.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.18649032s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
15052024-12-21T05:43:09.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 282.331098ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
15062024-12-21T05:43:09.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 687.137752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
15072024-12-21T05:43:09.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 944.026954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
15082024-12-21T05:43:09.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 610.115438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
15092024-12-21T05:43:09.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 1.264020803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
15102024-12-21T05:43:09.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 1.424635631s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
15112024-12-21T05:43:09.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 1.036434392s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
15122024-12-21T05:43:09.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 1.126239495s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
15132024-12-21T05:43:09.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 751.405557ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
15142024-12-21T05:43:09.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 804.718398ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
15152024-12-21T05:43:10.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 1.269482299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
15162024-12-21T05:43:10.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 589.536249ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
15172024-12-21T05:43:10.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 1.230278671s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
15182024-12-21T05:43:10.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.279684808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
15192024-12-21T05:43:10.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.478783913s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
15202024-12-21T05:43:10.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 966.409762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
15212024-12-21T05:43:10.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 739.058184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
15222024-12-21T05:43:10.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 1.468761885s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
15232024-12-21T05:43:10.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.091549203s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
15242024-12-21T05:43:10.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 677.26871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
15252024-12-21T05:43:10.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 1.128497476s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
15262024-12-21T05:43:10.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 1.34519978s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
15272024-12-21T05:43:10.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.413699593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
15282024-12-21T05:43:10.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 756.168074ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
15292024-12-21T05:43:10.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 1.015188821s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
15302024-12-21T05:43:10.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 606.430358ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
15312024-12-21T05:43:10.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 1.009212868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
15322024-12-21T05:43:10.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 709.945056ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
15332024-12-21T05:43:10.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 647.56415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
15342024-12-21T05:43:10.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 1.478855238s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
15352024-12-21T05:43:11.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 940.617236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
15362024-12-21T05:43:11.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 944.324012ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
15372024-12-21T05:43:11.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 1.298497208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
15382024-12-21T05:43:11.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 1.292872245s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
15392024-12-21T05:43:11.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.305400272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
15402024-12-21T05:43:11.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 688.574364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
15412024-12-21T05:43:11.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.464647014s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
15422024-12-21T05:43:11.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 1.241151885s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
15432024-12-21T05:43:11.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.434269586s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
15442024-12-21T05:43:11.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 1.151756746s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
15452024-12-21T05:43:11.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 592.093674ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
15462024-12-21T05:43:11.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 961.1364ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
15472024-12-21T05:43:11.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 839.617734ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
15482024-12-21T05:43:11.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 785.496241ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
15492024-12-21T05:43:11.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 663.630878ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
15502024-12-21T05:43:11.742ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56126
15512024-12-21T05:43:11.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 1.095050149s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
15522024-12-21T05:43:11.764ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 776 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56126 req_id = 3a718df2-53e4-46d4-be9a-fa1274dfcb79 response_code = 200 uri = /baseboard
15532024-12-21T05:43:11.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 1.377929161s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
15542024-12-21T05:43:11.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.398971563s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
15552024-12-21T05:43:11.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 1.15333464s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
15562024-12-21T05:43:12.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 1.208060767s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
15572024-12-21T05:43:12.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 658.652869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
15582024-12-21T05:43:12.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 849.930346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
15592024-12-21T05:43:12.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 1.450286745s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
15602024-12-21T05:43:12.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 1.025974061s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
15612024-12-21T05:43:12.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 1.031816407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
15622024-12-21T05:43:12.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 848.658088ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
15632024-12-21T05:43:12.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.273306328s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
15642024-12-21T05:43:12.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 644.078895ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
15652024-12-21T05:43:12.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 1.492770162s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
15662024-12-21T05:43:12.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 850.579148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
15672024-12-21T05:43:12.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 985.47826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
15682024-12-21T05:43:12.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 1.367887895s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
15692024-12-21T05:43:12.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 603.102383ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
15702024-12-21T05:43:12.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 815.015013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
15712024-12-21T05:43:12.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 698.413525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
15722024-12-21T05:43:12.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 531.728317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
15732024-12-21T05:43:13.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 717.08834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
15742024-12-21T05:43:13.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 898.9469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
15752024-12-21T05:43:13.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 970.244257ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
15762024-12-21T05:43:13.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 545.212426ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
15772024-12-21T05:43:13.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 681.636483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
15782024-12-21T05:43:13.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 692.039507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
15792024-12-21T05:43:13.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 993.392045ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
15802024-12-21T05:43:13.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.487319722s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
15812024-12-21T05:43:13.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 841.834736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
15822024-12-21T05:43:13.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 736.074189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
15832024-12-21T05:43:13.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 542.783721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
15842024-12-21T05:43:13.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 843.187233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
15852024-12-21T05:43:13.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 503.580395ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
15862024-12-21T05:43:13.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 631.340959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
15872024-12-21T05:43:13.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 772.78026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
15882024-12-21T05:43:13.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 920.756663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
15892024-12-21T05:43:13.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 1.189710631s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
15902024-12-21T05:43:13.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.386787785s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
15912024-12-21T05:43:13.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 1.058233045s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
15922024-12-21T05:43:14.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 745.292467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
15932024-12-21T05:43:14.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 899.622306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
15942024-12-21T05:43:14.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 1.435755766s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
15952024-12-21T05:43:14.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.407969902s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
15962024-12-21T05:43:14.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 606.518126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
15972024-12-21T05:43:14.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 1.196646365s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
15982024-12-21T05:43:14.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 1.041731555s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
15992024-12-21T05:43:14.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 914.714536ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
16002024-12-21T05:43:14.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 1.344953391s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
16012024-12-21T05:43:14.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 1.092869076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
16022024-12-21T05:43:14.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.284352811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
16032024-12-21T05:43:14.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 1.347758655s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
16042024-12-21T05:43:14.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 1.469360051s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
16052024-12-21T05:43:14.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 748.210807ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
16062024-12-21T05:43:14.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 965.211164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
16072024-12-21T05:43:14.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 1.423183455s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
16082024-12-21T05:43:14.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 938.303485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
16092024-12-21T05:43:14.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 553.538106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
16102024-12-21T05:43:14.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 1.399481352s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
16112024-12-21T05:43:14.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 1.274775974s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
16122024-12-21T05:43:15.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 1.02761468s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
16132024-12-21T05:43:15.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 947.308932ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
16142024-12-21T05:43:15.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.002935804s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
16152024-12-21T05:43:15.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 1.490295939s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
16162024-12-21T05:43:15.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 970.043514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
16172024-12-21T05:43:15.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 509.884784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
16182024-12-21T05:43:15.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 994.698465ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
16192024-12-21T05:43:15.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.131457435s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
16202024-12-21T05:43:15.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.106040818s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
16212024-12-21T05:43:15.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 1.03192182s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
16222024-12-21T05:43:15.593ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.975610222s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
16232024-12-21T05:43:15.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 873.90794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
16242024-12-21T05:43:15.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.039841421s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
16252024-12-21T05:43:15.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 1.219027618s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
16262024-12-21T05:43:15.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 980.552453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
16272024-12-21T05:43:15.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 1.490898468s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
16282024-12-21T05:43:15.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 864.822256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
16292024-12-21T05:43:15.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 715.653682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
16302024-12-21T05:43:16.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 957.981583ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
16312024-12-21T05:43:16.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 958.577561ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
16322024-12-21T05:43:16.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 734.824317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
16332024-12-21T05:43:16.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.166406446s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
16342024-12-21T05:43:16.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 727.620641ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
16352024-12-21T05:43:16.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 1.403731102s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
16362024-12-21T05:43:16.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 1.221837692s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
16372024-12-21T05:43:16.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 1.281649117s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
16382024-12-21T05:43:16.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 559.513218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
16392024-12-21T05:43:16.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 1.388238709s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
16402024-12-21T05:43:16.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 536.46513ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
16412024-12-21T05:43:16.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 515.176167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
16422024-12-21T05:43:16.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.162529066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
16432024-12-21T05:43:16.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.281988969s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
16442024-12-21T05:43:16.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 1.421281629s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
16452024-12-21T05:43:16.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 827.913051ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
16462024-12-21T05:43:16.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 970.07524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
16472024-12-21T05:43:16.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 1.23976454s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
16482024-12-21T05:43:16.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 1.161846326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
16492024-12-21T05:43:16.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.104430374s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
16502024-12-21T05:43:17.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 669.454208ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
16512024-12-21T05:43:17.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 566.1836ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
16522024-12-21T05:43:17.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 1.281755727s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
16532024-12-21T05:43:17.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 1.310126702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
16542024-12-21T05:43:17.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 974.007313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
16552024-12-21T05:43:17.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 1.204966399s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
16562024-12-21T05:43:17.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.252142931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
16572024-12-21T05:43:17.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 1.355506904s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
16582024-12-21T05:43:17.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 1.29191282s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
16592024-12-21T05:43:17.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 532.923315ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
16602024-12-21T05:43:17.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 602.676869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
16612024-12-21T05:43:17.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 740.307881ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
16622024-12-21T05:43:17.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 918.220512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
16632024-12-21T05:43:17.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 572.686266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
16642024-12-21T05:43:17.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.060638558s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
16652024-12-21T05:43:17.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 1.476379583s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
16662024-12-21T05:43:17.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.18001331s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
16672024-12-21T05:43:18.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.205320258s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
16682024-12-21T05:43:18.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 1.37303234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
16692024-12-21T05:43:18.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 597.923832ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
16702024-12-21T05:43:18.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 1.499497695s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
16712024-12-21T05:43:18.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 659.112297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
16722024-12-21T05:43:18.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 1.297474632s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
16732024-12-21T05:43:18.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 936.261583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
16742024-12-21T05:43:18.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 932.604856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
16752024-12-21T05:43:18.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 870.09037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
16762024-12-21T05:43:18.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 585.667195ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
16772024-12-21T05:43:18.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 796.237301ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
16782024-12-21T05:43:18.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 980.055347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
16792024-12-21T05:43:18.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 1.24442501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
16802024-12-21T05:43:18.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 874.917948ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
16812024-12-21T05:43:18.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 657.003303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
16822024-12-21T05:43:18.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 968.423418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
16832024-12-21T05:43:18.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 666.508729ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
16842024-12-21T05:43:18.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 1.420697673s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
16852024-12-21T05:43:18.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 1.212108273s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
16862024-12-21T05:43:19.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 545.22358ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
16872024-12-21T05:43:19.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 909.866309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
16882024-12-21T05:43:19.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 594.072609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
16892024-12-21T05:43:19.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 956.171266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
16902024-12-21T05:43:19.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 817.153592ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
16912024-12-21T05:43:19.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 1.067971328s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
16922024-12-21T05:43:19.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.420121681s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
16932024-12-21T05:43:19.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.291410344s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
16942024-12-21T05:43:19.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 1.427805705s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
16952024-12-21T05:43:19.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 1.403029772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
16962024-12-21T05:43:19.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 1.313398227s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
16972024-12-21T05:43:19.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 711.5215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
16982024-12-21T05:43:19.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.081817395s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
16992024-12-21T05:43:19.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.063905033s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
17002024-12-21T05:43:19.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 1.172798845s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
17012024-12-21T05:43:19.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 1.43487292s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
17022024-12-21T05:43:19.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 1.076158658s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
17032024-12-21T05:43:19.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 1.060363799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
17042024-12-21T05:43:19.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 1.365337003s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
17052024-12-21T05:43:20.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 1.304368193s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
17062024-12-21T05:43:20.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.028307264s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
17072024-12-21T05:43:20.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 714.693672ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
17082024-12-21T05:43:20.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 938.346921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
17092024-12-21T05:43:20.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 766.368297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
17102024-12-21T05:43:20.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 772.922461ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
17112024-12-21T05:43:20.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 708.765769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
17122024-12-21T05:43:20.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.33593896s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
17132024-12-21T05:43:20.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.241625138s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
17142024-12-21T05:43:20.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978") failed: Property not found. retry in 1.154004194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
17152024-12-21T05:43:20.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 781.65366ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
17162024-12-21T05:43:20.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 762.943338ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
17172024-12-21T05:43:20.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 737.726852ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
17182024-12-21T05:43:20.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 1.007362874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
17192024-12-21T05:43:20.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 826.71282ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
17202024-12-21T05:43:20.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 909.852497ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
17212024-12-21T05:43:20.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 675.906908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
17222024-12-21T05:43:20.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 1.211435783s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
17232024-12-21T05:43:21.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 1.204050315s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
17242024-12-21T05:43:21.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 1.289240402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
17252024-12-21T05:43:21.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 1.234409166s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
17262024-12-21T05:43:21.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 931.920694ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
17272024-12-21T05:43:21.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 1.444716524s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
17282024-12-21T05:43:21.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 1.08427474s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
17292024-12-21T05:43:21.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 1.27164384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
17302024-12-21T05:43:21.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 1.004624979s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
17312024-12-21T05:43:21.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.261041406s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
17322024-12-21T05:43:21.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710") failed: Property not found. retry in 968.44106ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
17332024-12-21T05:43:21.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 1.373830634s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
17342024-12-21T05:43:21.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 1.110896363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
17352024-12-21T05:43:21.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 1.02034253s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
17362024-12-21T05:43:21.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 542.531366ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
17372024-12-21T05:43:21.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 602.613663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
17382024-12-21T05:43:21.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da") failed: Property not found. retry in 1.162047796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
17392024-12-21T05:43:21.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 888.793272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
17402024-12-21T05:43:22.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 532.600784ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
17412024-12-21T05:43:22.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114") failed: Property not found. retry in 1.141805247s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
17422024-12-21T05:43:22.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3") failed: Property not found. retry in 797.104464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
17432024-12-21T05:43:22.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 896.130196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
17442024-12-21T05:43:22.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6") failed: Property not found. retry in 829.13524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
17452024-12-21T05:43:22.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 595.833404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
17462024-12-21T05:43:22.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de") failed: Property not found. retry in 1.379653136s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
17472024-12-21T05:43:22.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 976.800717ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
17482024-12-21T05:43:22.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0") failed: Property not found. retry in 780.275316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
17492024-12-21T05:43:22.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7") failed: Property not found. retry in 940.335782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
17502024-12-21T05:43:22.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9") failed: Property not found. retry in 866.337378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
17512024-12-21T05:43:22.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95") failed: Property not found. retry in 548.601737ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
17522024-12-21T05:43:22.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89") failed: Property not found. retry in 609.361928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
17532024-12-21T05:43:22.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9") failed: Property not found. retry in 705.577105ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
17542024-12-21T05:43:22.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa") failed: Property not found. retry in 1.063302159s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
17552024-12-21T05:43:22.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8") failed: Property not found. retry in 1.307544885s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
17562024-12-21T05:43:22.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f") failed: Property not found. retry in 662.92636ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
17572024-12-21T05:43:22.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8") failed: Property not found. retry in 1.102758585s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
17582024-12-21T05:43:23.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153") failed: Property not found. retry in 1.302594136s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
17592024-12-21T05:43:23.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49") failed: Property not found. retry in 793.100975ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
17602024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_ac588187-c3ee-42b3-9cd7-09be6d4cd5de
17612024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_9007028a-d045-423f-bb8c-b25a29015153
17622024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_5f5da623-23f2-4e2f-b423-7097e8481e49
17632024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_b381127d-ac24-4ced-abe2-28a1272fd710
17642024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa
17652024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_8afe77a5-36b9-444f-a9d2-0b12478fdbb9
17662024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_1d62b24a-7296-4ee0-a63f-68a2228d07b7
17672024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_8e83eb15-36d2-46e0-ba92-fc84d84438b0
17682024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_3e936875-2f74-4e20-99be-0527df1a8978
17692024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_cd5047d1-3ca5-44c4-a116-b6c9b040e114
17702024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_aeb9fe3d-4c16-4800-8b97-6eeaac78bcc8
17712024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_4d89cf30-77fc-43dd-b352-0e05c3e104da
17722024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_4c5d0e65-66c8-4b42-9538-d497e5b523f9
17732024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_0b597c3c-305d-4d4f-ad19-4f4d978040c6
17742024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_5539f2b1-1861-4dbb-974a-1247914c9a95
17752024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_1877e20e-fbcc-4240-a6e8-744f4889600f
17762024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_58a3e4e5-2240-49f1-94f3-64b58498ae89
17772024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_239d37ca-8dc0-40e0-9102-dc9d1846f5c8
17782024-12-21T05:43:24.509ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_a36fbb2b-c5e5-44ea-9c54-9dcd5f74d9a3
17792024-12-21T05:43:24.510ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17802024-12-21T05:43:24.553ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17812024-12-21T05:43:24.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42887238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51963 req_id = a2d0be7a-a863-4da1-97e7-22e62cfe1787 response_code = 204 uri = /omicron-zones
17822024-12-21T05:43:24.613ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17832024-12-21T05:43:24.768ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17842024-12-21T05:43:24.796ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
17852024-12-21T05:43:24.842ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
17862024-12-21T05:43:29.192ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17872024-12-21T05:43:29.195ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.740657155s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
17882024-12-21T05:43:29.312ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17892024-12-21T05:43:29.389ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17902024-12-21T05:43:29.601ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17912024-12-21T05:43:29.839ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17922024-12-21T05:43:30.116ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17932024-12-21T05:43:30.376ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17942024-12-21T05:43:30.605ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17952024-12-21T05:43:30.924ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17962024-12-21T05:43:31.462ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17972024-12-21T05:43:31.943ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17982024-12-21T05:43:32.256ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/9691c7fa-48ff-41f7-95ba-39aeacfa3c56/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17992024-12-21T05:43:35.075ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2c78ee25-4e3b-4430-8af8-1942b4e9b99a", "content-length": "173", "date": "Sat, 21 Dec 2024 05:43:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"9691c7fa-48ff-41f7-95ba-39aeacfa3c56\"", request_id: "2c78ee25-4e3b-4430-8af8-1942b4e9b99a" } file = sled-agent/src/rack_setup/service.rs:1078
18002024-12-21T05:43:35.804ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4b11f4f5-d642-4f77-8264-cd62a21c678f", "content-length": "173", "date": "Sat, 21 Dec 2024 05:43:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"9691c7fa-48ff-41f7-95ba-39aeacfa3c56\"", request_id: "4b11f4f5-d642-4f77-8264-cd62a21c678f" } file = sled-agent/src/rack_setup/service.rs:1078
18012024-12-21T05:43:37.174ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "87e12190-6e0f-4817-a3c4-81f95da0e014", "content-length": "173", "date": "Sat, 21 Dec 2024 05:43:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"9691c7fa-48ff-41f7-95ba-39aeacfa3c56\"", request_id: "87e12190-6e0f-4817-a3c4-81f95da0e014" } file = sled-agent/src/rack_setup/service.rs:1078
18022024-12-21T05:43:39.810ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8f7b1742-ce0c-4b48-9076-7e1f69ff03e3", "content-length": "173", "date": "Sat, 21 Dec 2024 05:43:39 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"67885466-b1c6-48f5-a800-f848c80749b6\"", request_id: "8f7b1742-ce0c-4b48-9076-7e1f69ff03e3" } file = sled-agent/src/rack_setup/service.rs:1078
18032024-12-21T05:43:41.801ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62184
18042024-12-21T05:43:41.801ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62184 req_id = 69505bc1-eee1-4498-bcbc-8f05e7e58833 response_code = 200 uri = /baseboard
18052024-12-21T05:43:42.128ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e4985a38-27cf-4759-bfa2-d7cee8faa75d", "content-length": "173", "date": "Sat, 21 Dec 2024 05:43:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"67885466-b1c6-48f5-a800-f848c80749b6\"", request_id: "e4985a38-27cf-4759-bfa2-d7cee8faa75d" } file = sled-agent/src/rack_setup/service.rs:1078
18062024-12-21T05:43:44.935ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1e6297e3-4e2e-4e5f-ae3b-6eed3d189975", "content-length": "173", "date": "Sat, 21 Dec 2024 05:43:44 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"67885466-b1c6-48f5-a800-f848c80749b6\"", request_id: "1e6297e3-4e2e-4e5f-ae3b-6eed3d189975" } file = sled-agent/src/rack_setup/service.rs:1078
18072024-12-21T05:43:48.343ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "350bf521-efaf-41db-858f-73de04e92b34", "content-length": "173", "date": "Sat, 21 Dec 2024 05:43:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"67885466-b1c6-48f5-a800-f848c80749b6\"", request_id: "350bf521-efaf-41db-858f-73de04e92b34" } file = sled-agent/src/rack_setup/service.rs:1078
18082024-12-21T05:43:51.476ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d1c164a9-f799-4356-a9b8-e433a19bfbeb", "content-length": "173", "date": "Sat, 21 Dec 2024 05:43:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"67885466-b1c6-48f5-a800-f848c80749b6\"", request_id: "d1c164a9-f799-4356-a9b8-e433a19bfbeb" } file = sled-agent/src/rack_setup/service.rs:1078
18092024-12-21T05:43:54.156ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1ae19e63-b3eb-41ec-ba3a-a5452c193175", "content-length": "173", "date": "Sat, 21 Dec 2024 05:43:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"67885466-b1c6-48f5-a800-f848c80749b6\"", request_id: "1ae19e63-b3eb-41ec-ba3a-a5452c193175" } file = sled-agent/src/rack_setup/service.rs:1078
18102024-12-21T05:43:59.750ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c20e21f1-acdc-481f-a8bd-90bc72c3dca1", "content-length": "173", "date": "Sat, 21 Dec 2024 05:43:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"67885466-b1c6-48f5-a800-f848c80749b6\"", request_id: "c20e21f1-acdc-481f-a8bd-90bc72c3dca1" } file = sled-agent/src/rack_setup/service.rs:1078
18112024-12-21T05:44:01.137ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
18122024-12-21T05:44:01.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63846
18132024-12-21T05:44:01.237ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18142024-12-21T05:44:01.237ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18152024-12-21T05:44:01.239ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-zones.json file = common/src/ledger.rs:177
18162024-12-21T05:44:01.242ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-zones.json file = common/src/ledger.rs:177
18172024-12-21T05:44:01.255ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18182024-12-21T05:44:01.255ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7912c084-27e1-426d-a3ef-7d0f642d9382
18192024-12-21T05:44:01.279ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18202024-12-21T05:44:01.279ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3351d590-858e-45b6-91ff-51f0d9e17995
18212024-12-21T05:44:01.303ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18222024-12-21T05:44:01.304ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_871c983c-3586-410a-849e-2f5b0cbe8e62
18232024-12-21T05:44:01.325ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18242024-12-21T05:44:01.325ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a
18252024-12-21T05:44:01.346ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18262024-12-21T05:44:01.346ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722
18272024-12-21T05:44:01.366ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18282024-12-21T05:44:01.366ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb
18292024-12-21T05:44:01.387ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18302024-12-21T05:44:01.387ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9
18312024-12-21T05:44:01.409ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18322024-12-21T05:44:01.409ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0
18332024-12-21T05:44:01.429ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18342024-12-21T05:44:01.429ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa625e73-0c39-487d-9929-b234b9ea83f9
18352024-12-21T05:44:01.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63846 req_id = 7670d2dc-0e50-4f15-8a88-5980a6cad1af response_code = 200 uri = /inventory
18362024-12-21T05:44:06.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39779
18372024-12-21T05:44:06.042ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 57b78e12-2ea9-463d-a689-565344dffa73, kind: Service { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa }, name: Name("external-dns-284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 59])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7068213c-a7cd-4f1b-b697-368276e5ea37, kind: Service { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 }, name: Name("external-dns-5f5da623-23f2-4e2f-b423-7097e8481e49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ad27df-342d-495e-a4af-9b1bd7ef97af, kind: Service { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de }, name: Name("nexus-ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2186fc88-ccae-445f-be44-94dc147f97b5, kind: Service { id: b381127d-ac24-4ced-abe2-28a1272fd710 }, name: Name("nexus-b381127d-ac24-4ced-abe2-28a1272fd710"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3a266615-9b66-4a87-93bc-6f160dec5481, kind: Service { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 }, name: Name("nexus-4c5d0e65-66c8-4b42-9538-d497e5b523f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18382024-12-21T05:44:06.042ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18392024-12-21T05:44:06.042ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18402024-12-21T05:44:06.042ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18412024-12-21T05:44:06.042ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18422024-12-21T05:44:06.042ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18432024-12-21T05:44:06.042ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18442024-12-21T05:44:06.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39779 req_id = 23843ee7-9100-4a98-a3e8-3d83754311cf response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18452024-12-21T05:44:06.043ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
18462024-12-21T05:44:06.047ZINFOSledAgent (RSS): Writing ledger to /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18472024-12-21T05:44:06.049ZINFOSledAgent (RSS): Writing ledger to /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18482024-12-21T05:44:06.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45357
18492024-12-21T05:44:06.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18502024-12-21T05:44:06.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18512024-12-21T05:44:06.308ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-zones.json file = common/src/ledger.rs:177
18522024-12-21T05:44:06.308ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-zones.json file = common/src/ledger.rs:177
18532024-12-21T05:44:06.320ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18542024-12-21T05:44:06.320ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7912c084-27e1-426d-a3ef-7d0f642d9382
18552024-12-21T05:44:06.345ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18562024-12-21T05:44:06.345ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3351d590-858e-45b6-91ff-51f0d9e17995
18572024-12-21T05:44:06.368ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18582024-12-21T05:44:06.368ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_871c983c-3586-410a-849e-2f5b0cbe8e62
18592024-12-21T05:44:06.392ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18602024-12-21T05:44:06.392ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a
18612024-12-21T05:44:06.415ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18622024-12-21T05:44:06.416ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722
18632024-12-21T05:44:06.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56085
18642024-12-21T05:44:06.434ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 57b78e12-2ea9-463d-a689-565344dffa73, kind: Service { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa }, name: Name("external-dns-284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 59])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7068213c-a7cd-4f1b-b697-368276e5ea37, kind: Service { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 }, name: Name("external-dns-5f5da623-23f2-4e2f-b423-7097e8481e49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ad27df-342d-495e-a4af-9b1bd7ef97af, kind: Service { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de }, name: Name("nexus-ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2186fc88-ccae-445f-be44-94dc147f97b5, kind: Service { id: b381127d-ac24-4ced-abe2-28a1272fd710 }, name: Name("nexus-b381127d-ac24-4ced-abe2-28a1272fd710"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3a266615-9b66-4a87-93bc-6f160dec5481, kind: Service { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 }, name: Name("nexus-4c5d0e65-66c8-4b42-9538-d497e5b523f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18652024-12-21T05:44:06.434ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18662024-12-21T05:44:06.434ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18672024-12-21T05:44:06.434ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18682024-12-21T05:44:06.435ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18692024-12-21T05:44:06.435ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18702024-12-21T05:44:06.435ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18712024-12-21T05:44:06.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 612 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56085 req_id = 890deb33-c60f-4b44-afe9-6ddfbb4100da response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18722024-12-21T05:44:06.438ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18732024-12-21T05:44:06.438ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb
18742024-12-21T05:44:06.458ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18752024-12-21T05:44:06.458ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9
18762024-12-21T05:44:06.480ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18772024-12-21T05:44:06.480ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0
18782024-12-21T05:44:06.502ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18792024-12-21T05:44:06.502ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa625e73-0c39-487d-9929-b234b9ea83f9
18802024-12-21T05:44:06.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207953 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45357 req_id = 12474d28-5428-47a4-9f36-1e36f59d22f4 response_code = 200 uri = /inventory
18812024-12-21T05:44:06.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34932
18822024-12-21T05:44:06.623ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 57b78e12-2ea9-463d-a689-565344dffa73, kind: Service { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa }, name: Name("external-dns-284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 59])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7068213c-a7cd-4f1b-b697-368276e5ea37, kind: Service { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 }, name: Name("external-dns-5f5da623-23f2-4e2f-b423-7097e8481e49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ad27df-342d-495e-a4af-9b1bd7ef97af, kind: Service { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de }, name: Name("nexus-ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2186fc88-ccae-445f-be44-94dc147f97b5, kind: Service { id: b381127d-ac24-4ced-abe2-28a1272fd710 }, name: Name("nexus-b381127d-ac24-4ced-abe2-28a1272fd710"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3a266615-9b66-4a87-93bc-6f160dec5481, kind: Service { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 }, name: Name("nexus-4c5d0e65-66c8-4b42-9538-d497e5b523f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18832024-12-21T05:44:06.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18842024-12-21T05:44:06.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18852024-12-21T05:44:06.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18862024-12-21T05:44:06.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18872024-12-21T05:44:06.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18882024-12-21T05:44:06.623ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18892024-12-21T05:44:06.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 875 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34932 req_id = 653ae953-dc1a-4a3c-b6ba-0f54139d6aa2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18902024-12-21T05:44:07.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53701
18912024-12-21T05:44:07.028ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 57b78e12-2ea9-463d-a689-565344dffa73, kind: Service { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa }, name: Name("external-dns-284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 59])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7068213c-a7cd-4f1b-b697-368276e5ea37, kind: Service { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 }, name: Name("external-dns-5f5da623-23f2-4e2f-b423-7097e8481e49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ad27df-342d-495e-a4af-9b1bd7ef97af, kind: Service { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de }, name: Name("nexus-ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2186fc88-ccae-445f-be44-94dc147f97b5, kind: Service { id: b381127d-ac24-4ced-abe2-28a1272fd710 }, name: Name("nexus-b381127d-ac24-4ced-abe2-28a1272fd710"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3a266615-9b66-4a87-93bc-6f160dec5481, kind: Service { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 }, name: Name("nexus-4c5d0e65-66c8-4b42-9538-d497e5b523f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18922024-12-21T05:44:07.029ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18932024-12-21T05:44:07.029ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18942024-12-21T05:44:07.029ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18952024-12-21T05:44:07.029ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18962024-12-21T05:44:07.029ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18972024-12-21T05:44:07.029ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18982024-12-21T05:44:07.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53701 req_id = 87ba386b-2656-43c5-9917-e939610e308d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18992024-12-21T05:44:08.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52523
19002024-12-21T05:44:08.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52523 req_id = 4d61e959-6ebb-45b9-950b-34a4dce30da7 response_code = 200 uri = /vpc-routes
19012024-12-21T05:44:08.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50658
19022024-12-21T05:44:08.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50658 req_id = c3182ac9-4faa-420b-987f-3052c2e78a7f response_code = 200 uri = /v2p
19032024-12-21T05:44:08.161ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
19042024-12-21T05:44:08.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52523 req_id = e1a0b86e-e575-47e8-9c0f-120552b3ca1d response_code = 204 uri = /eip-gateways
19052024-12-21T05:44:08.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57687
19062024-12-21T05:44:08.413ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19072024-12-21T05:44:08.516ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19082024-12-21T05:44:08.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172807 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57687 req_id = dafff777-eee7-4dd7-b6b3-6ee477400c7d response_code = 204 uri = /switch-ports
19092024-12-21T05:44:08.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1720 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52523 req_id = 952a0020-a666-43e7-86fc-a8edfe8a4ad2 response_code = 204 uri = /vpc-routes
19102024-12-21T05:44:08.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 961 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57687 req_id = e03efee0-c6e1-4716-9332-6a9341159d04 response_code = 200 uri = /network-bootstore-config
19112024-12-21T05:44:08.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48248
19122024-12-21T05:44:08.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48248 req_id = 74fdc62f-2093-45ec-b478-e140ca0dd107 response_code = 200 uri = /vpc-routes
19132024-12-21T05:44:08.652ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
19142024-12-21T05:44:08.653ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19152024-12-21T05:44:08.654ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19162024-12-21T05:44:08.655ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
19172024-12-21T05:44:08.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3445 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57687 req_id = 76e5e8f2-dfe0-4ee2-b78f-eccb0f7d077a response_code = 204 uri = /network-bootstore-config
19182024-12-21T05:44:08.803ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
19192024-12-21T05:44:08.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48248 req_id = 000619b0-d5c3-4fc0-912f-9db2eab6fc11 response_code = 204 uri = /eip-gateways
19202024-12-21T05:44:08.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48248 req_id = fdbb1075-1ccb-434d-8bfa-8a4a20f8de9b response_code = 204 uri = /vpc-routes
19212024-12-21T05:44:08.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39270
19222024-12-21T05:44:08.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39270 req_id = 8f427245-343b-4f4e-93ab-7ab1b816612b response_code = 200 uri = /v2p
19232024-12-21T05:44:08.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50732
19242024-12-21T05:44:08.917ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19252024-12-21T05:44:08.956ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19262024-12-21T05:44:09.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99924 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50732 req_id = 206b5a82-b101-42bd-883b-01528c210cf3 response_code = 204 uri = /switch-ports
19272024-12-21T05:44:09.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50732 req_id = 192d7a0c-8b3c-49bf-88e5-f0cd1b2ac2a8 response_code = 200 uri = /network-bootstore-config
19282024-12-21T05:44:11.835ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33095
19292024-12-21T05:44:11.835ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33095 req_id = cb22c15f-84a4-4cec-8fae-2d57c684d0b7 response_code = 200 uri = /baseboard
19302024-12-21T05:44:13.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33239
19312024-12-21T05:44:13.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33239 req_id = 0567e432-ebf3-46f0-a528-63d21709d9a8 response_code = 200 uri = /vpc-routes
19322024-12-21T05:44:13.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52606
19332024-12-21T05:44:13.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52606 req_id = 47dbc868-8099-4c08-a977-ab47bf0f5808 response_code = 200 uri = /vpc-routes
19342024-12-21T05:44:13.328ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
19352024-12-21T05:44:13.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52606 req_id = 28453789-a99b-4681-a389-0c72ce1b05fc response_code = 204 uri = /eip-gateways
19362024-12-21T05:44:13.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52606 req_id = 06decfe1-e29a-4f7e-86bc-fa5edaaa4a9e response_code = 204 uri = /vpc-routes
19372024-12-21T05:44:13.340ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
19382024-12-21T05:44:13.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33239 req_id = ecc028ba-bfc0-46bb-8866-ca0c55ef5b96 response_code = 204 uri = /eip-gateways
19392024-12-21T05:44:13.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33239 req_id = ccd00ca9-1755-4c71-935e-14bae6f8dd3a response_code = 204 uri = /vpc-routes
19402024-12-21T05:44:13.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47803
19412024-12-21T05:44:13.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19422024-12-21T05:44:13.412ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19432024-12-21T05:44:13.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95924 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47803 req_id = 5f47a5a0-564f-4fce-837b-8bd01f6a45b7 response_code = 204 uri = /switch-ports
19442024-12-21T05:44:13.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44003
19452024-12-21T05:44:13.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44003 req_id = 205bdaeb-bf5b-4534-a3e5-d7b55acff0d9 response_code = 200 uri = /v2p
19462024-12-21T05:44:13.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47803 req_id = 3ff89072-0049-4e6e-81b7-f5b889759b21 response_code = 200 uri = /network-bootstore-config
19472024-12-21T05:44:17.830ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:35623 remote_addr = [fd00:1122:3344:101::d]:57258 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
19482024-12-21T05:44:17.860ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29162 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 0aba4010-0c82-4da1-85c9-4a8a4cb49b7a response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
19492024-12-21T05:44:38.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60727
19502024-12-21T05:44:38.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60727 req_id = b8d9c1f7-aea6-44d4-ae7e-e3f20b8eb134 response_code = 200 uri = /vpc-routes
19512024-12-21T05:44:38.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32800
19522024-12-21T05:44:38.360ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19532024-12-21T05:44:38.423ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19542024-12-21T05:44:38.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144205 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32800 req_id = 7f758771-ac71-4633-8e6c-4b9e24453dac response_code = 204 uri = /switch-ports
19552024-12-21T05:44:38.505ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
19562024-12-21T05:44:38.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60727 req_id = 86c17dc8-734b-416a-aea2-007413cb34ea response_code = 204 uri = /eip-gateways
19572024-12-21T05:44:38.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32800 req_id = c5784df6-32fd-4dee-abdd-ee32c0a257fb response_code = 200 uri = /network-bootstore-config
19582024-12-21T05:44:38.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61522
19592024-12-21T05:44:38.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61522 req_id = 430867d9-3201-4add-96cf-e6833f3c2f3f response_code = 200 uri = /v2p
19602024-12-21T05:44:38.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36925
19612024-12-21T05:44:38.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36925 req_id = cefa73d0-b504-4cc4-ad86-5a82aaa164e3 response_code = 200 uri = /vpc-routes
19622024-12-21T05:44:38.617ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
19632024-12-21T05:44:38.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36925 req_id = 56da0cf0-3180-45c8-86e5-dc142f35d883 response_code = 204 uri = /eip-gateways
19642024-12-21T05:44:38.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60727 req_id = 4a5aecd6-3968-456f-970c-651c483ac50f response_code = 204 uri = /vpc-routes
19652024-12-21T05:44:38.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37664
19662024-12-21T05:44:38.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37664 req_id = 2ea2cc52-752f-4461-820e-2931df073254 response_code = 200 uri = /v2p
19672024-12-21T05:44:38.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36925 req_id = d95c69b4-ab25-4b6a-b20a-c587d46791b1 response_code = 204 uri = /vpc-routes
19682024-12-21T05:44:38.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44377
19692024-12-21T05:44:38.941ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19702024-12-21T05:44:38.979ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19712024-12-21T05:44:39.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91913 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44377 req_id = 6da4524f-ccf3-4cd3-8506-7745e9870761 response_code = 204 uri = /switch-ports
19722024-12-21T05:44:39.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44377 req_id = 3cf62dc2-f813-47f5-a6c3-db63f94d2f90 response_code = 200 uri = /network-bootstore-config
19732024-12-21T05:44:41.876ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43350
19742024-12-21T05:44:41.876ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43350 req_id = 25b8a050-49a5-41a5-8edb-e951534e56a8 response_code = 200 uri = /baseboard
19752024-12-21T05:44:43.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62754
19762024-12-21T05:44:43.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62754 req_id = df4e6241-cd7b-46e3-8fd9-58993cba2571 response_code = 200 uri = /vpc-routes
19772024-12-21T05:44:43.208ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
19782024-12-21T05:44:43.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62754 req_id = 921ae02a-3ee0-4f73-ba9e-d733fef7ff3e response_code = 204 uri = /eip-gateways
19792024-12-21T05:44:43.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54261
19802024-12-21T05:44:43.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54261 req_id = 4ea5746e-3e74-40d7-9203-ba4f898d0a54 response_code = 200 uri = /v2p
19812024-12-21T05:44:43.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62754 req_id = 00f253b4-1f7b-491b-a9b6-8bf44e76ba88 response_code = 204 uri = /vpc-routes
19822024-12-21T05:44:43.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48510
19832024-12-21T05:44:43.425ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19842024-12-21T05:44:43.460ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19852024-12-21T05:44:43.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89821 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48510 req_id = 58aa3452-6e56-45fc-8a18-2e38c40e5b98 response_code = 204 uri = /switch-ports
19862024-12-21T05:44:43.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48510 req_id = 38ac7d62-abe5-4ce4-b8da-b3581f40cf2f response_code = 200 uri = /network-bootstore-config
19872024-12-21T05:44:47.838ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9920 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 959d4c3f-6592-4b41-8aff-31a15052b62c response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
19882024-12-21T05:45:08.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50368
19892024-12-21T05:45:08.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50368 req_id = 65af1cc0-24bd-46bb-a37e-cf784a6e4a32 response_code = 200 uri = /vpc-routes
19902024-12-21T05:45:08.092ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
19912024-12-21T05:45:08.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50368 req_id = aef38a04-67d8-461f-b138-70120e913e14 response_code = 204 uri = /eip-gateways
19922024-12-21T05:45:08.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50368 req_id = b16253d0-e283-46bc-9e9e-8c2a7a7c2985 response_code = 204 uri = /vpc-routes
19932024-12-21T05:45:08.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44779
19942024-12-21T05:45:08.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44779 req_id = fbd35d2f-02d6-4197-9c7d-15b42c0e00ba response_code = 200 uri = /v2p
19952024-12-21T05:45:08.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52270
19962024-12-21T05:45:08.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19972024-12-21T05:45:08.375ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19982024-12-21T05:45:08.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134090 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52270 req_id = 79c62553-bfb8-4116-870d-503b7ba7ec33 response_code = 204 uri = /switch-ports
19992024-12-21T05:45:08.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52270 req_id = 263ac8d9-79bd-4be9-b36c-aa9028412277 response_code = 200 uri = /network-bootstore-config
20002024-12-21T05:45:08.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60274
20012024-12-21T05:45:08.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60274 req_id = eb654634-c3d5-4ef8-b211-fd41e2cf21fe response_code = 200 uri = /vpc-routes
20022024-12-21T05:45:08.675ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
20032024-12-21T05:45:08.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60274 req_id = 1ee3f5e1-0d26-4bb0-889f-f93eab05d697 response_code = 204 uri = /eip-gateways
20042024-12-21T05:45:08.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60274 req_id = 1017499d-5e56-4ac2-82da-97a36eeb92a5 response_code = 204 uri = /vpc-routes
20052024-12-21T05:45:08.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43172
20062024-12-21T05:45:08.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43172 req_id = 681c4158-7797-4743-bdc4-76c7626391ae response_code = 200 uri = /v2p
20072024-12-21T05:45:08.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33602
20082024-12-21T05:45:08.771ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20092024-12-21T05:45:08.804ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20102024-12-21T05:45:08.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33602 req_id = 5261a531-4572-4379-b902-528384def670 response_code = 204 uri = /switch-ports
20112024-12-21T05:45:08.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33602 req_id = f34d8c24-a0a1-46af-95ad-a807f42fe0e6 response_code = 200 uri = /network-bootstore-config
20122024-12-21T05:45:11.908ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50262
20132024-12-21T05:45:11.908ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50262 req_id = 5b405cb1-4732-48a4-b8ee-3ebdab3a4583 response_code = 200 uri = /baseboard
20142024-12-21T05:45:13.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45518
20152024-12-21T05:45:13.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45518 req_id = 8fa32552-0c6e-4b2b-8f54-59c4b80bde9a response_code = 200 uri = /vpc-routes
20162024-12-21T05:45:13.200ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
20172024-12-21T05:45:13.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45518 req_id = 10639a0e-4352-4778-9bdc-68594d0e4123 response_code = 204 uri = /eip-gateways
20182024-12-21T05:45:13.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45518 req_id = 0f97e9aa-1f38-4396-ab9a-5a319eaaf6a2 response_code = 204 uri = /vpc-routes
20192024-12-21T05:45:13.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38612
20202024-12-21T05:45:13.239ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20212024-12-21T05:45:13.278ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20222024-12-21T05:45:13.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94264 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38612 req_id = 06538eda-312f-420c-8c48-69f11f8acee3 response_code = 204 uri = /switch-ports
20232024-12-21T05:45:13.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55625
20242024-12-21T05:45:13.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38612 req_id = a4cded8d-ac61-40b3-9f45-14a95cd9b5b7 response_code = 200 uri = /network-bootstore-config
20252024-12-21T05:45:13.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55625 req_id = 08592f58-0a85-46bb-8273-f3148d62cf3c response_code = 200 uri = /v2p
20262024-12-21T05:45:17.837ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8445 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 392e5bee-bd57-4eee-8847-4c7a1820d3d2 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
20272024-12-21T05:45:38.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63645
20282024-12-21T05:45:38.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63645 req_id = 53ed7a8a-79db-4517-be0c-4d77a6efde18 response_code = 200 uri = /vpc-routes
20292024-12-21T05:45:38.174ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
20302024-12-21T05:45:38.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63645 req_id = a788d269-448b-4dea-b146-dd4357cfdd3c response_code = 204 uri = /eip-gateways
20312024-12-21T05:45:38.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38572
20322024-12-21T05:45:38.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38572 req_id = 802cbd0b-4611-411f-8d8e-d7890b06271e response_code = 200 uri = /v2p
20332024-12-21T05:45:38.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63645 req_id = 32d47b73-ed6f-4beb-bce0-b4912097173c response_code = 204 uri = /vpc-routes
20342024-12-21T05:45:38.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65248
20352024-12-21T05:45:38.345ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20362024-12-21T05:45:38.411ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20372024-12-21T05:45:38.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145294 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65248 req_id = 1ac7a0d4-17a7-4e31-ae25-27fc5eea122a response_code = 204 uri = /switch-ports
20382024-12-21T05:45:38.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65248 req_id = 871fcf9a-173d-4003-b7ab-d26df1cd8317 response_code = 200 uri = /network-bootstore-config
20392024-12-21T05:45:38.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60954
20402024-12-21T05:45:38.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60954 req_id = f18f0a53-58a2-49aa-bd3d-7d6030028149 response_code = 200 uri = /vpc-routes
20412024-12-21T05:45:38.858ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
20422024-12-21T05:45:38.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60954 req_id = 1821676f-5937-4e42-9173-4e0646d4410c response_code = 204 uri = /eip-gateways
20432024-12-21T05:45:38.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44437
20442024-12-21T05:45:38.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44437 req_id = 78c75855-f4b9-4768-93bb-3b4f8d2472cc response_code = 200 uri = /v2p
20452024-12-21T05:45:38.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60954 req_id = 7e5e04ef-d203-4630-985c-ee892bd3d9ee response_code = 204 uri = /vpc-routes
20462024-12-21T05:45:39.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54319
20472024-12-21T05:45:39.093ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20482024-12-21T05:45:39.131ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20492024-12-21T05:45:39.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95742 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54319 req_id = 5f3fe35c-b247-4430-bc7f-cdc173d3ab65 response_code = 204 uri = /switch-ports
20502024-12-21T05:45:39.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54319 req_id = 06247e11-88d8-4400-9094-8c7a8d45f4b0 response_code = 200 uri = /network-bootstore-config
20512024-12-21T05:45:41.942ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58741
20522024-12-21T05:45:41.943ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58741 req_id = ed105dba-1cb8-47c5-be01-0760d2ee24ea response_code = 200 uri = /baseboard
20532024-12-21T05:45:43.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58087
20542024-12-21T05:45:43.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58087 req_id = 1efeb16b-874a-4b1f-afe4-4f6eaded8932 response_code = 200 uri = /vpc-routes
20552024-12-21T05:45:43.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
20562024-12-21T05:45:43.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58087 req_id = bb641a02-ac71-4b01-ac16-ce55391dc0d0 response_code = 204 uri = /eip-gateways
20572024-12-21T05:45:43.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46933
20582024-12-21T05:45:43.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46933 req_id = 2df4e861-ac48-4a91-838b-487a54c1468a response_code = 200 uri = /v2p
20592024-12-21T05:45:43.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58087 req_id = 764b24ef-91de-47e2-a211-ea60340242a5 response_code = 204 uri = /vpc-routes
20602024-12-21T05:45:43.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57169
20612024-12-21T05:45:43.579ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20622024-12-21T05:45:43.617ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20632024-12-21T05:45:43.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95420 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57169 req_id = d6f18be5-8748-4068-bff5-442130f43255 response_code = 204 uri = /switch-ports
20642024-12-21T05:45:43.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57169 req_id = 906ada2a-4da4-46a9-a2bb-90be7ac5992c response_code = 200 uri = /network-bootstore-config
20652024-12-21T05:45:47.836ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7563 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 669b05f3-2583-4770-ad8d-0b4c5e48c180 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
20662024-12-21T05:46:08.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44511
20672024-12-21T05:46:08.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44511 req_id = 872b887c-615b-496d-84c0-b97dbc76c9b1 response_code = 200 uri = /vpc-routes
20682024-12-21T05:46:08.113ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
20692024-12-21T05:46:08.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44511 req_id = 65a74b31-308d-4db8-8145-c996c0e2b0a2 response_code = 204 uri = /eip-gateways
20702024-12-21T05:46:08.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44511 req_id = 84779369-a4bf-4e28-a431-5fc75a41d8a0 response_code = 204 uri = /vpc-routes
20712024-12-21T05:46:08.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34604
20722024-12-21T05:46:08.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20732024-12-21T05:46:08.217ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20742024-12-21T05:46:08.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94695 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34604 req_id = 27f1ede7-9320-4902-a250-031a60fd3cf3 response_code = 204 uri = /switch-ports
20752024-12-21T05:46:08.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40421
20762024-12-21T05:46:08.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34604 req_id = 985748de-9ed3-4dae-a0ae-7658ca7d0eab response_code = 200 uri = /network-bootstore-config
20772024-12-21T05:46:08.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40421 req_id = 239c44dc-562a-4ecc-ae0d-3a86ce13b1a4 response_code = 200 uri = /v2p
20782024-12-21T05:46:08.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58166
20792024-12-21T05:46:08.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58166 req_id = c3bf6cb4-20eb-4756-9125-8ecf28c35395 response_code = 200 uri = /vpc-routes
20802024-12-21T05:46:08.679ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
20812024-12-21T05:46:08.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58166 req_id = 72c505b5-cb0e-431a-be07-80803e43bf49 response_code = 204 uri = /eip-gateways
20822024-12-21T05:46:08.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58166 req_id = 19723c9c-2d4a-45d3-a645-850f378dc23e response_code = 204 uri = /vpc-routes
20832024-12-21T05:46:08.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53271
20842024-12-21T05:46:08.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53271 req_id = 17bdf469-3646-4720-a8da-177c492414cf response_code = 200 uri = /v2p
20852024-12-21T05:46:08.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58236
20862024-12-21T05:46:08.784ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20872024-12-21T05:46:08.822ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20882024-12-21T05:46:08.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94235 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58236 req_id = 254c6c59-e554-445a-bd3b-710300bee80b response_code = 204 uri = /switch-ports
20892024-12-21T05:46:08.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58236 req_id = cf771b65-2481-47e0-ac97-b83e60644469 response_code = 200 uri = /network-bootstore-config
20902024-12-21T05:46:11.977ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64808
20912024-12-21T05:46:11.978ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64808 req_id = 6665729e-b138-4a85-8af1-99daa31d2b77 response_code = 200 uri = /baseboard
20922024-12-21T05:46:13.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40952
20932024-12-21T05:46:13.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40952 req_id = 78a998cb-1e38-4b98-854b-ae5f2ab184d9 response_code = 200 uri = /vpc-routes
20942024-12-21T05:46:13.270ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
20952024-12-21T05:46:13.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40952 req_id = 22ce8698-1eb3-4659-bf9d-4bad43a3a216 response_code = 204 uri = /eip-gateways
20962024-12-21T05:46:13.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40952 req_id = 153462d7-3001-40b0-9d65-9c4c8a6e6f49 response_code = 204 uri = /vpc-routes
20972024-12-21T05:46:13.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35990
20982024-12-21T05:46:13.355ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20992024-12-21T05:46:13.395ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21002024-12-21T05:46:13.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96245 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35990 req_id = 4f159a76-40ed-4eb1-bd0b-49ed14c29133 response_code = 204 uri = /switch-ports
21012024-12-21T05:46:13.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58854
21022024-12-21T05:46:13.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35990 req_id = bcc84c9a-f2c2-4457-bcf6-1b8260fe6ec6 response_code = 200 uri = /network-bootstore-config
21032024-12-21T05:46:13.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58854 req_id = 91c22ea5-a0a8-401d-8d41-1347f1d4167f response_code = 200 uri = /v2p
21042024-12-21T05:46:17.837ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9037 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 7384976b-34f2-417d-a6ca-0577dfa3a122 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
21052024-12-21T05:46:30.724ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
21062024-12-21T05:46:38.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45400
21072024-12-21T05:46:38.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45400 req_id = 8fe92091-9701-44ac-9180-d2a7266dd5d1 response_code = 200 uri = /vpc-routes
21082024-12-21T05:46:38.333ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
21092024-12-21T05:46:38.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45400 req_id = 7dacc816-dcad-4643-9198-78cccd9b0c74 response_code = 204 uri = /eip-gateways
21102024-12-21T05:46:38.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45400 req_id = 9486ba92-f2d5-49f3-bd8c-bd92c4dac8a9 response_code = 204 uri = /vpc-routes
21112024-12-21T05:46:38.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47412
21122024-12-21T05:46:38.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47412 req_id = fffb25f3-0215-449e-9d67-9ad2d060e77f response_code = 200 uri = /v2p
21132024-12-21T05:46:38.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48721
21142024-12-21T05:46:38.521ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21152024-12-21T05:46:38.570ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21162024-12-21T05:46:38.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110216 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48721 req_id = fb94f9d7-9788-4eb3-b893-0498628a6f73 response_code = 204 uri = /switch-ports
21172024-12-21T05:46:38.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48721 req_id = d768350e-dcab-4409-af6a-b6712a75a179 response_code = 200 uri = /network-bootstore-config
21182024-12-21T05:46:38.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54741
21192024-12-21T05:46:38.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54741 req_id = 8d5239a1-482e-4b42-9043-2eb8a48b6567 response_code = 200 uri = /vpc-routes
21202024-12-21T05:46:38.907ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
21212024-12-21T05:46:38.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54741 req_id = dca6740a-f23d-4380-97c7-9b8e30e64f82 response_code = 204 uri = /eip-gateways
21222024-12-21T05:46:38.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46763
21232024-12-21T05:46:38.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46763 req_id = 7b4c507d-0f94-459a-b002-d9bfad65d57d response_code = 200 uri = /v2p
21242024-12-21T05:46:39.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33136
21252024-12-21T05:46:39.028ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21262024-12-21T05:46:39.066ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21272024-12-21T05:46:39.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33136 req_id = 150584ce-801d-403f-93f6-6b2aba0d7e7b response_code = 204 uri = /switch-ports
21282024-12-21T05:46:39.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54741 req_id = 5af985c4-8761-49e5-92e0-d8368394b5d0 response_code = 204 uri = /vpc-routes
21292024-12-21T05:46:39.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33136 req_id = 29c61a8c-d158-452f-983e-2372cf63c8ff response_code = 200 uri = /network-bootstore-config
21302024-12-21T05:46:42.011ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44279
21312024-12-21T05:46:42.011ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44279 req_id = 00cc3bd5-496f-4cb8-91b7-e39e17a947d1 response_code = 200 uri = /baseboard
21322024-12-21T05:46:43.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43265
21332024-12-21T05:46:43.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43265 req_id = 9cc5ed31-e68f-43fa-a6da-500e7901661a response_code = 200 uri = /vpc-routes
21342024-12-21T05:46:43.318ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
21352024-12-21T05:46:43.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43265 req_id = 3adc03d6-3f40-4fb1-b203-21c7f34dd05a response_code = 204 uri = /eip-gateways
21362024-12-21T05:46:43.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60131
21372024-12-21T05:46:43.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60131 req_id = b4416256-85a2-44fb-843f-b2665e01bef9 response_code = 200 uri = /v2p
21382024-12-21T05:46:43.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43265 req_id = 84b79322-e6e5-4ba9-bfd3-1e7c2fef51be response_code = 204 uri = /vpc-routes
21392024-12-21T05:46:43.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54051
21402024-12-21T05:46:43.633ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21412024-12-21T05:46:43.672ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21422024-12-21T05:46:43.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96635 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54051 req_id = 7a21d31c-e89a-4e13-a966-afb39d9b66fb response_code = 204 uri = /switch-ports
21432024-12-21T05:46:43.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54051 req_id = 5c2fb71c-2973-4119-9f49-6fd3e5c894c3 response_code = 200 uri = /network-bootstore-config
21442024-12-21T05:46:47.836ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7843 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = a6df9867-68e0-4598-b5e0-01538b24ab83 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
21452024-12-21T05:47:08.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49574
21462024-12-21T05:47:08.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49574 req_id = bbd09eb9-b5c3-47cd-a7db-75cf6f7144d0 response_code = 200 uri = /v2p
21472024-12-21T05:47:08.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57119
21482024-12-21T05:47:08.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57119 req_id = 7ffb8ee3-550f-4f1d-8a73-81c7c01f5f91 response_code = 200 uri = /vpc-routes
21492024-12-21T05:47:08.247ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
21502024-12-21T05:47:08.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57119 req_id = 2e48e9d0-23ea-407d-b6c0-055ee65026e3 response_code = 204 uri = /eip-gateways
21512024-12-21T05:47:08.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57119 req_id = 6a9f4d06-bd5d-4029-be65-ef27a7ec7ba4 response_code = 204 uri = /vpc-routes
21522024-12-21T05:47:08.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46555
21532024-12-21T05:47:08.365ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21542024-12-21T05:47:08.415ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21552024-12-21T05:47:08.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122668 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46555 req_id = 1741dc8c-ada5-4542-a0aa-a97360144d09 response_code = 204 uri = /switch-ports
21562024-12-21T05:47:08.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46555 req_id = b796f7c2-b8ce-4cb7-bd07-3c77d5058afa response_code = 200 uri = /network-bootstore-config
21572024-12-21T05:47:08.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44243
21582024-12-21T05:47:08.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44243 req_id = 8dae8271-1fa7-4831-8615-4fd8c5dbaeaa response_code = 200 uri = /vpc-routes
21592024-12-21T05:47:08.549ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
21602024-12-21T05:47:08.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44243 req_id = 4c76216d-7db4-4579-a456-e34490e26298 response_code = 204 uri = /eip-gateways
21612024-12-21T05:47:08.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44243 req_id = c04f2096-0dc9-4da9-ae85-1cf02d74c929 response_code = 204 uri = /vpc-routes
21622024-12-21T05:47:08.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62961
21632024-12-21T05:47:08.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62961 req_id = b08c3e91-dde1-4064-8fb9-1f452731aa4a response_code = 200 uri = /v2p
21642024-12-21T05:47:08.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36505
21652024-12-21T05:47:08.657ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21662024-12-21T05:47:08.698ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21672024-12-21T05:47:08.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95666 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36505 req_id = afbb6804-a06e-4d6c-b805-42781925a938 response_code = 204 uri = /switch-ports
21682024-12-21T05:47:08.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36505 req_id = b6849e03-9b0c-4a20-940e-1a7e7e4ddbe9 response_code = 200 uri = /network-bootstore-config
21692024-12-21T05:47:12.043ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34622
21702024-12-21T05:47:12.043ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34622 req_id = 7bbbfacf-775d-445a-a151-88df0833cbc4 response_code = 200 uri = /baseboard
21712024-12-21T05:47:13.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64936
21722024-12-21T05:47:13.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64936 req_id = a6434155-4738-4980-9104-d03a97384a7c response_code = 200 uri = /vpc-routes
21732024-12-21T05:47:13.091ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
21742024-12-21T05:47:13.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64936 req_id = dc7f17fc-1449-4afd-8056-596fcb90a736 response_code = 204 uri = /eip-gateways
21752024-12-21T05:47:13.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64936 req_id = 2e75454f-eb8e-45b9-b202-6b8ed399ed7b response_code = 204 uri = /vpc-routes
21762024-12-21T05:47:13.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47056
21772024-12-21T05:47:13.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21782024-12-21T05:47:13.228ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21792024-12-21T05:47:13.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97166 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47056 req_id = 35241fc6-eb9f-4d5d-998a-039a77b1d490 response_code = 204 uri = /switch-ports
21802024-12-21T05:47:13.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44388
21812024-12-21T05:47:13.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44388 req_id = 478c92f3-a8fa-4d83-9bc8-a1015d06189c response_code = 200 uri = /v2p
21822024-12-21T05:47:13.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47056 req_id = fbba2dbc-d1d2-48cd-a194-8485a2b90302 response_code = 200 uri = /network-bootstore-config
21832024-12-21T05:47:17.836ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8234 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 3d9e1174-4cfa-4a7e-82ae-e767d1e7ac7c response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
21842024-12-21T05:47:38.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34363
21852024-12-21T05:47:38.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34363 req_id = ef0a8e12-c4ac-44f8-b1e1-618bd12ed0d1 response_code = 200 uri = /vpc-routes
21862024-12-21T05:47:38.399ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
21872024-12-21T05:47:38.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34363 req_id = 296116cc-ffc6-45a2-88ed-20162fb997d7 response_code = 204 uri = /eip-gateways
21882024-12-21T05:47:38.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60887
21892024-12-21T05:47:38.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60887 req_id = c25171eb-3ea4-4ce2-8537-1f18a93915e7 response_code = 200 uri = /v2p
21902024-12-21T05:47:38.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34363 req_id = c4326f65-929d-4696-ba50-90f7bc31753c response_code = 204 uri = /vpc-routes
21912024-12-21T05:47:38.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64594
21922024-12-21T05:47:38.553ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21932024-12-21T05:47:38.593ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21942024-12-21T05:47:38.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95030 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64594 req_id = b0c4ca50-3edf-4c42-8222-f83ec7033040 response_code = 204 uri = /switch-ports
21952024-12-21T05:47:38.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64594 req_id = 2c6f433e-fb2f-4ce8-9995-931aa9060565 response_code = 200 uri = /network-bootstore-config
21962024-12-21T05:47:38.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40073
21972024-12-21T05:47:38.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40073 req_id = 5dafc86f-d100-469a-8bec-e236f90989ce response_code = 200 uri = /vpc-routes
21982024-12-21T05:47:38.767ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
21992024-12-21T05:47:38.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40073 req_id = cacee66e-35f5-4cc9-add7-d6f4efbefacb response_code = 204 uri = /eip-gateways
22002024-12-21T05:47:38.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40073 req_id = c5263e0f-2afe-4195-8595-09fcba347c14 response_code = 204 uri = /vpc-routes
22012024-12-21T05:47:38.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35353
22022024-12-21T05:47:38.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35353 req_id = 0f9fb305-b418-41d5-b0c5-8913c96f1f3a response_code = 200 uri = /v2p
22032024-12-21T05:47:38.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37936
22042024-12-21T05:47:38.867ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22052024-12-21T05:47:38.909ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22062024-12-21T05:47:38.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103659 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37936 req_id = 99a9b470-543c-40b4-83d2-5ec06c6ca8ba response_code = 204 uri = /switch-ports
22072024-12-21T05:47:38.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37936 req_id = fa8a6933-2360-481c-a2d1-386cd6e836cb response_code = 200 uri = /network-bootstore-config
22082024-12-21T05:47:42.076ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56307
22092024-12-21T05:47:42.076ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56307 req_id = 285f8acd-d256-44eb-903c-bb3df57842ee response_code = 200 uri = /baseboard
22102024-12-21T05:47:43.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51264
22112024-12-21T05:47:43.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51264 req_id = 2924b137-f6fc-4ac2-a731-93b50e6a6745 response_code = 200 uri = /vpc-routes
22122024-12-21T05:47:43.177ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
22132024-12-21T05:47:43.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51264 req_id = 2cc7884c-138c-469c-8e99-c610080a3956 response_code = 204 uri = /eip-gateways
22142024-12-21T05:47:43.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51264 req_id = ca9d34a5-db85-41bb-8436-c60cb3b0080f response_code = 204 uri = /vpc-routes
22152024-12-21T05:47:43.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43038
22162024-12-21T05:47:43.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43038 req_id = 25bee994-8de9-4911-b78b-3a2fc4e740b5 response_code = 200 uri = /v2p
22172024-12-21T05:47:43.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44834
22182024-12-21T05:47:43.424ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22192024-12-21T05:47:43.470ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22202024-12-21T05:47:43.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110137 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44834 req_id = 2bb92f34-22bf-441f-b1a7-215cadd71097 response_code = 204 uri = /switch-ports
22212024-12-21T05:47:43.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44834 req_id = 3704f4f0-9d25-43f6-a772-32b4185fa091 response_code = 200 uri = /network-bootstore-config
22222024-12-21T05:47:47.835ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7359 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 6e9aa421-e167-41f7-86a3-abbb2b1ac945 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
22232024-12-21T05:48:08.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41671
22242024-12-21T05:48:08.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41671 req_id = 0edd788c-b6b1-4490-a7f3-031e68d23b78 response_code = 200 uri = /vpc-routes
22252024-12-21T05:48:08.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
22262024-12-21T05:48:08.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41671 req_id = bda6a5da-331c-44c7-be2e-c9d6116e1bf0 response_code = 204 uri = /eip-gateways
22272024-12-21T05:48:08.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41671 req_id = 24bf97d8-86cc-4534-b3bd-5c596c07ca29 response_code = 204 uri = /vpc-routes
22282024-12-21T05:48:08.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55407
22292024-12-21T05:48:08.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55407 req_id = 482ab0fe-fd61-4794-80a4-15eb4b8aafc3 response_code = 200 uri = /v2p
22302024-12-21T05:48:08.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40674
22312024-12-21T05:48:08.210ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22322024-12-21T05:48:08.252ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22332024-12-21T05:48:08.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40674 req_id = 3ba58f44-8ffc-41d6-aa52-268550e42351 response_code = 204 uri = /switch-ports
22342024-12-21T05:48:08.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40674 req_id = d8f4820d-d039-4f19-a116-730ba0984c11 response_code = 200 uri = /network-bootstore-config
22352024-12-21T05:48:08.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52832
22362024-12-21T05:48:08.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52832 req_id = 324f32cd-80d9-4ef0-88c7-88f6e5f0da64 response_code = 200 uri = /vpc-routes
22372024-12-21T05:48:08.541ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
22382024-12-21T05:48:08.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52832 req_id = e7926b45-1396-4b0f-8926-fb8da134a606 response_code = 204 uri = /eip-gateways
22392024-12-21T05:48:08.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52832 req_id = 9f1217cc-541d-46dc-a4f5-ee363938e5a7 response_code = 204 uri = /vpc-routes
22402024-12-21T05:48:08.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35566
22412024-12-21T05:48:08.686ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22422024-12-21T05:48:08.729ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22432024-12-21T05:48:08.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103615 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35566 req_id = 83f7226f-e6b5-4733-8865-5c90accb9b77 response_code = 204 uri = /switch-ports
22442024-12-21T05:48:08.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60513
22452024-12-21T05:48:08.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60513 req_id = 5793e374-6478-4b45-9e1e-355b12a00a0f response_code = 200 uri = /v2p
22462024-12-21T05:48:08.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35566 req_id = ca26a34a-fe5a-468b-a091-bb4ace6c835d response_code = 200 uri = /network-bootstore-config
22472024-12-21T05:48:12.107ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39588
22482024-12-21T05:48:12.108ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39588 req_id = 121be1f2-e286-4998-ab9b-748c98c1e40b response_code = 200 uri = /baseboard
22492024-12-21T05:48:13.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43209
22502024-12-21T05:48:13.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43209 req_id = 7f03a7c2-53ad-43a1-b6a2-9744910ad202 response_code = 200 uri = /vpc-routes
22512024-12-21T05:48:13.187ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
22522024-12-21T05:48:13.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43209 req_id = ef29fd18-b5c5-480f-afdd-7bdf5de4bc7c response_code = 204 uri = /eip-gateways
22532024-12-21T05:48:13.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43209 req_id = b509ef95-c79f-4c0a-9bf6-11914b3317db response_code = 204 uri = /vpc-routes
22542024-12-21T05:48:13.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46657
22552024-12-21T05:48:13.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46657 req_id = 1bde382d-223e-4852-8a1b-040d1c0e6409 response_code = 200 uri = /v2p
22562024-12-21T05:48:13.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55657
22572024-12-21T05:48:13.277ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22582024-12-21T05:48:13.314ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22592024-12-21T05:48:13.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90296 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55657 req_id = 49874195-abc7-4f91-bc18-e207ddb61069 response_code = 204 uri = /switch-ports
22602024-12-21T05:48:13.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55657 req_id = 7919aa0f-69aa-4ab4-bcdc-61c7858bdb55 response_code = 200 uri = /network-bootstore-config
22612024-12-21T05:48:17.838ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10494 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = b598c6ab-2cd4-4748-a43f-00c92fb8b125 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
22622024-12-21T05:48:38.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53979
22632024-12-21T05:48:38.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53979 req_id = 92c4482a-7ad7-4c5e-a335-70da30e48967 response_code = 200 uri = /vpc-routes
22642024-12-21T05:48:38.184ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
22652024-12-21T05:48:38.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53979 req_id = 511d230c-7dff-4bda-af83-c0f9c956f4d6 response_code = 204 uri = /eip-gateways
22662024-12-21T05:48:38.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53360
22672024-12-21T05:48:38.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53360 req_id = a6f32384-255f-4cd4-8b0a-0c6c950843b9 response_code = 200 uri = /v2p
22682024-12-21T05:48:38.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53979 req_id = 1d3aefa5-cb42-4897-a5ff-20965a2051ab response_code = 204 uri = /vpc-routes
22692024-12-21T05:48:38.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33382
22702024-12-21T05:48:38.314ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22712024-12-21T05:48:38.356ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22722024-12-21T05:48:38.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138882 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33382 req_id = 16b66f9d-f815-4fb8-8f1b-6f4d6844baff response_code = 204 uri = /switch-ports
22732024-12-21T05:48:38.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33382 req_id = 675691da-eafc-4438-b215-ba7d3affa99e response_code = 200 uri = /network-bootstore-config
22742024-12-21T05:48:38.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45404
22752024-12-21T05:48:38.588ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 57b78e12-2ea9-463d-a689-565344dffa73, kind: Service { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa }, name: Name("external-dns-284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 59])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7068213c-a7cd-4f1b-b697-368276e5ea37, kind: Service { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 }, name: Name("external-dns-5f5da623-23f2-4e2f-b423-7097e8481e49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ad27df-342d-495e-a4af-9b1bd7ef97af, kind: Service { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de }, name: Name("nexus-ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2186fc88-ccae-445f-be44-94dc147f97b5, kind: Service { id: b381127d-ac24-4ced-abe2-28a1272fd710 }, name: Name("nexus-b381127d-ac24-4ced-abe2-28a1272fd710"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3a266615-9b66-4a87-93bc-6f160dec5481, kind: Service { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 }, name: Name("nexus-4c5d0e65-66c8-4b42-9538-d497e5b523f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22762024-12-21T05:48:38.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22772024-12-21T05:48:38.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22782024-12-21T05:48:38.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22792024-12-21T05:48:38.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22802024-12-21T05:48:38.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22812024-12-21T05:48:38.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22822024-12-21T05:48:38.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 407 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45404 req_id = 97beab51-b4eb-4fd5-8ea2-11c12260b3b6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22832024-12-21T05:48:38.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41049
22842024-12-21T05:48:38.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41049 req_id = 8ba1c808-614e-4e5f-ac70-296b05cd7ca6 response_code = 200 uri = /vpc-routes
22852024-12-21T05:48:38.686ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
22862024-12-21T05:48:38.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41049 req_id = 03e195bc-13b1-40f1-a8fe-723c1e237656 response_code = 204 uri = /eip-gateways
22872024-12-21T05:48:38.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41049 req_id = 2db2e803-c5c1-43f1-9fc8-b9da3f134e54 response_code = 204 uri = /vpc-routes
22882024-12-21T05:48:38.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55215
22892024-12-21T05:48:38.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55215 req_id = c8f464eb-32b7-42c6-b7dd-ef06cfacb6fd response_code = 200 uri = /v2p
22902024-12-21T05:48:38.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47555
22912024-12-21T05:48:38.938ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22922024-12-21T05:48:38.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22932024-12-21T05:48:39.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95086 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47555 req_id = d04a0e41-0fbe-41cd-8264-cd75a7cae78c response_code = 204 uri = /switch-ports
22942024-12-21T05:48:39.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47555 req_id = 59058a21-69bd-407e-bb0e-06d710a5e5b4 response_code = 200 uri = /network-bootstore-config
22952024-12-21T05:48:39.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53493
22962024-12-21T05:48:39.195ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 57b78e12-2ea9-463d-a689-565344dffa73, kind: Service { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa }, name: Name("external-dns-284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 59])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7068213c-a7cd-4f1b-b697-368276e5ea37, kind: Service { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 }, name: Name("external-dns-5f5da623-23f2-4e2f-b423-7097e8481e49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ad27df-342d-495e-a4af-9b1bd7ef97af, kind: Service { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de }, name: Name("nexus-ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2186fc88-ccae-445f-be44-94dc147f97b5, kind: Service { id: b381127d-ac24-4ced-abe2-28a1272fd710 }, name: Name("nexus-b381127d-ac24-4ced-abe2-28a1272fd710"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3a266615-9b66-4a87-93bc-6f160dec5481, kind: Service { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 }, name: Name("nexus-4c5d0e65-66c8-4b42-9538-d497e5b523f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22972024-12-21T05:48:39.195ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22982024-12-21T05:48:39.195ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22992024-12-21T05:48:39.195ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23002024-12-21T05:48:39.195ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23012024-12-21T05:48:39.195ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23022024-12-21T05:48:39.195ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23032024-12-21T05:48:39.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 392 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53493 req_id = f977465c-c987-49b3-a5d8-16358ab34a82 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23042024-12-21T05:48:42.139ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48481
23052024-12-21T05:48:42.139ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48481 req_id = d5ba70d3-9e6a-44e9-a8e6-65814647f343 response_code = 200 uri = /baseboard
23062024-12-21T05:48:43.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48684
23072024-12-21T05:48:43.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48684 req_id = 31db8644-d956-4977-a669-a4392baa8b51 response_code = 200 uri = /vpc-routes
23082024-12-21T05:48:43.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57946
23092024-12-21T05:48:43.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57946 req_id = e71c91d0-4613-4464-a8a3-4c29f71378e0 response_code = 200 uri = /v2p
23102024-12-21T05:48:43.380ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
23112024-12-21T05:48:43.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48684 req_id = 17cfd541-c841-41c7-a9a6-bc2da36f5ce1 response_code = 204 uri = /eip-gateways
23122024-12-21T05:48:43.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48684 req_id = ab54f5eb-7acd-435c-9d14-d86bce320bd9 response_code = 204 uri = /vpc-routes
23132024-12-21T05:48:43.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33942
23142024-12-21T05:48:43.472ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23152024-12-21T05:48:43.512ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23162024-12-21T05:48:43.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98080 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33942 req_id = ccf7d444-fec7-46b0-bb38-b93fd357db23 response_code = 204 uri = /switch-ports
23172024-12-21T05:48:43.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39845
23182024-12-21T05:48:43.571ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 57b78e12-2ea9-463d-a689-565344dffa73, kind: Service { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa }, name: Name("external-dns-284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 59])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7068213c-a7cd-4f1b-b697-368276e5ea37, kind: Service { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 }, name: Name("external-dns-5f5da623-23f2-4e2f-b423-7097e8481e49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ad27df-342d-495e-a4af-9b1bd7ef97af, kind: Service { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de }, name: Name("nexus-ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2186fc88-ccae-445f-be44-94dc147f97b5, kind: Service { id: b381127d-ac24-4ced-abe2-28a1272fd710 }, name: Name("nexus-b381127d-ac24-4ced-abe2-28a1272fd710"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3a266615-9b66-4a87-93bc-6f160dec5481, kind: Service { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 }, name: Name("nexus-4c5d0e65-66c8-4b42-9538-d497e5b523f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23192024-12-21T05:48:43.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33942 req_id = f1dd161a-35d5-437d-933a-a89347e67d11 response_code = 200 uri = /network-bootstore-config
23202024-12-21T05:48:43.571ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23212024-12-21T05:48:43.571ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23222024-12-21T05:48:43.571ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23232024-12-21T05:48:43.571ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23242024-12-21T05:48:43.571ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23252024-12-21T05:48:43.571ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23262024-12-21T05:48:43.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39845 req_id = 7ae03715-0605-4508-8f60-534c67072552 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23272024-12-21T05:48:47.835ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7675 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = a19f4aa8-8a72-4ece-8beb-ae27c5be233e response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
23282024-12-21T05:49:08.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61609
23292024-12-21T05:49:08.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61609 req_id = 49cd8cc7-34d3-4319-a034-448cc8736acc response_code = 200 uri = /vpc-routes
23302024-12-21T05:49:08.074ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
23312024-12-21T05:49:08.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61609 req_id = fae7ce5d-c04a-4228-8e83-3123c7ebbb65 response_code = 204 uri = /eip-gateways
23322024-12-21T05:49:08.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61609 req_id = 1a72b7d0-2301-435b-851c-d73c18cc0a74 response_code = 204 uri = /vpc-routes
23332024-12-21T05:49:08.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51600
23342024-12-21T05:49:08.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51600 req_id = 8fefba6d-de6d-42db-b94d-d9daf40cbbe7 response_code = 200 uri = /v2p
23352024-12-21T05:49:08.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37173
23362024-12-21T05:49:08.136ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23372024-12-21T05:49:08.171ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23382024-12-21T05:49:08.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86974 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37173 req_id = 0bdcedea-f8b1-47b5-b9ef-6890610bae20 response_code = 204 uri = /switch-ports
23392024-12-21T05:49:08.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37173 req_id = 399eed7c-9c45-4215-a1ec-e8819e6af41a response_code = 200 uri = /network-bootstore-config
23402024-12-21T05:49:08.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46269
23412024-12-21T05:49:08.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46269 req_id = aea1f990-f67b-4dfa-973f-d93b59b18981 response_code = 200 uri = /vpc-routes
23422024-12-21T05:49:08.632ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
23432024-12-21T05:49:08.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46269 req_id = 800ae5f2-4f21-4644-80b1-5e434e1cca7c response_code = 204 uri = /eip-gateways
23442024-12-21T05:49:08.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46269 req_id = bf0c5367-07bd-44c7-a06c-927ea841dfbd response_code = 204 uri = /vpc-routes
23452024-12-21T05:49:08.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59455
23462024-12-21T05:49:08.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59455 req_id = e15b65d1-28af-4535-9698-f1d5537f046d response_code = 200 uri = /v2p
23472024-12-21T05:49:08.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62295
23482024-12-21T05:49:08.790ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23492024-12-21T05:49:08.830ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23502024-12-21T05:49:08.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95779 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62295 req_id = 1c87f8db-9477-4952-9b13-d71ea19427af response_code = 204 uri = /switch-ports
23512024-12-21T05:49:08.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62295 req_id = 53637b9e-e813-49bd-a201-d8a14bf7709d response_code = 200 uri = /network-bootstore-config
23522024-12-21T05:49:12.172ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59248
23532024-12-21T05:49:12.172ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59248 req_id = 11381dcc-7008-489a-b55a-9bb9398f0066 response_code = 200 uri = /baseboard
23542024-12-21T05:49:13.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61420
23552024-12-21T05:49:13.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61420 req_id = 49eb1838-8a96-441e-840e-9471ec6f4777 response_code = 200 uri = /vpc-routes
23562024-12-21T05:49:13.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
23572024-12-21T05:49:13.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61420 req_id = 239741d7-fb0a-49e9-b78b-b71d9dcb094d response_code = 204 uri = /eip-gateways
23582024-12-21T05:49:13.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61420 req_id = 7151332d-733e-4ef3-928f-fa3d1d4485eb response_code = 204 uri = /vpc-routes
23592024-12-21T05:49:13.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54581
23602024-12-21T05:49:13.281ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23612024-12-21T05:49:13.322ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23622024-12-21T05:49:13.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96357 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54581 req_id = cf318ede-5ebb-4d29-bcda-eda16dfbcc09 response_code = 204 uri = /switch-ports
23632024-12-21T05:49:13.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50654
23642024-12-21T05:49:13.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50654 req_id = d407fb4f-958d-47f8-a86f-9bcaf4ec8f8d response_code = 200 uri = /v2p
23652024-12-21T05:49:13.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54581 req_id = bfdffcc0-b8a2-4556-8444-8993ac4085e3 response_code = 200 uri = /network-bootstore-config
23662024-12-21T05:49:17.834ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7488 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = abe9ca4c-aa64-49c5-86e6-7e811734a514 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
23672024-12-21T05:49:38.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33575
23682024-12-21T05:49:38.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33575 req_id = f8d70c0b-720f-4e55-8faf-d1e419a69e35 response_code = 200 uri = /vpc-routes
23692024-12-21T05:49:38.187ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
23702024-12-21T05:49:38.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33575 req_id = c7564872-8745-43eb-8c80-1967ec49c85f response_code = 204 uri = /eip-gateways
23712024-12-21T05:49:38.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63429
23722024-12-21T05:49:38.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63429 req_id = 4ab94a0f-3119-4094-88b8-0130e3c56917 response_code = 200 uri = /v2p
23732024-12-21T05:49:38.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33575 req_id = 545b36a0-53cf-4865-9116-a4ad8fc8bceb response_code = 204 uri = /vpc-routes
23742024-12-21T05:49:38.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51204
23752024-12-21T05:49:38.466ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23762024-12-21T05:49:38.506ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23772024-12-21T05:49:38.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51204 req_id = 9895c0aa-6a1d-4465-be97-4d129602b54b response_code = 204 uri = /switch-ports
23782024-12-21T05:49:38.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51204 req_id = faf5dd7d-813b-4dbe-9c2f-c6e01e488d55 response_code = 200 uri = /network-bootstore-config
23792024-12-21T05:49:38.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64896
23802024-12-21T05:49:38.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64896 req_id = 9911a84e-f97e-44f2-9663-71fbd018320c response_code = 200 uri = /v2p
23812024-12-21T05:49:38.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39476
23822024-12-21T05:49:38.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39476 req_id = b109181a-a5c6-412d-87dc-187730fe6d58 response_code = 200 uri = /vpc-routes
23832024-12-21T05:49:38.697ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
23842024-12-21T05:49:38.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39476 req_id = a4c07c4d-87af-4add-ab84-75b15585a577 response_code = 204 uri = /eip-gateways
23852024-12-21T05:49:38.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39476 req_id = f0abf31e-567f-47e9-8e8d-114370a681ac response_code = 204 uri = /vpc-routes
23862024-12-21T05:49:38.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55533
23872024-12-21T05:49:38.938ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23882024-12-21T05:49:38.976ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23892024-12-21T05:49:39.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97171 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55533 req_id = 6d57d7d3-e3c6-4ef0-8e11-6bdd56ced12b response_code = 204 uri = /switch-ports
23902024-12-21T05:49:39.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55533 req_id = 83181d1d-1e87-47e0-b8d6-740d8e2629e7 response_code = 200 uri = /network-bootstore-config
23912024-12-21T05:49:42.205ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64854
23922024-12-21T05:49:42.205ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64854 req_id = d53e42bd-50a4-4de3-9c17-1778e14f9a55 response_code = 200 uri = /baseboard
23932024-12-21T05:49:43.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38135
23942024-12-21T05:49:43.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38135 req_id = cc0f4a41-b333-4f95-8b80-60d1981f2342 response_code = 200 uri = /vpc-routes
23952024-12-21T05:49:43.314ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
23962024-12-21T05:49:43.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38135 req_id = cc468df5-2fc3-4615-a012-00f726f4ffeb response_code = 204 uri = /eip-gateways
23972024-12-21T05:49:43.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38135 req_id = 238edaef-bbb9-48b2-a297-32e3c76b5922 response_code = 204 uri = /vpc-routes
23982024-12-21T05:49:43.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63883
23992024-12-21T05:49:43.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63883 req_id = c550fec9-632f-4507-89ed-296926ed9dea response_code = 200 uri = /v2p
24002024-12-21T05:49:43.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44913
24012024-12-21T05:49:43.601ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24022024-12-21T05:49:43.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24032024-12-21T05:49:43.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95273 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44913 req_id = f70d9609-50f6-4e40-90f4-6dfbc77c5545 response_code = 204 uri = /switch-ports
24042024-12-21T05:49:43.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44913 req_id = 55567785-6f33-4d09-8eb7-663ba534e43b response_code = 200 uri = /network-bootstore-config
24052024-12-21T05:49:47.834ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7290 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 1f685cff-b557-4079-8ae5-4b399fc1fa25 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
24062024-12-21T05:50:08.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36285
24072024-12-21T05:50:08.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36285 req_id = ef7c10aa-6a40-4d7f-bd8c-555b757a03bc response_code = 200 uri = /vpc-routes
24082024-12-21T05:50:08.082ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
24092024-12-21T05:50:08.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36285 req_id = 3a3b378b-12c2-4f95-89ee-62c7caa17c81 response_code = 204 uri = /eip-gateways
24102024-12-21T05:50:08.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36285 req_id = 8304985b-4db8-4f97-a956-30529e0612fb response_code = 204 uri = /vpc-routes
24112024-12-21T05:50:08.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45733
24122024-12-21T05:50:08.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45733 req_id = 20d45bbf-e2d9-4753-950d-c4bdb23d8959 response_code = 200 uri = /v2p
24132024-12-21T05:50:08.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50806
24142024-12-21T05:50:08.176ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24152024-12-21T05:50:08.215ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24162024-12-21T05:50:08.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102135 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50806 req_id = 1557e583-5744-4203-ae5d-05681b4fea5e response_code = 204 uri = /switch-ports
24172024-12-21T05:50:08.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50806 req_id = 6704fa7a-c1cc-4b03-9a51-97dc0f96206d response_code = 200 uri = /network-bootstore-config
24182024-12-21T05:50:08.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54903
24192024-12-21T05:50:08.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54903 req_id = b767fcf1-1279-433d-8161-d0836625dd3f response_code = 200 uri = /vpc-routes
24202024-12-21T05:50:08.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39714
24212024-12-21T05:50:08.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39714 req_id = 82b4fc5f-0835-4799-bfd6-05d3305c4a9d response_code = 200 uri = /v2p
24222024-12-21T05:50:08.602ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
24232024-12-21T05:50:08.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54903 req_id = 7137e605-2f7d-4cf3-9275-7542c85fc95c response_code = 204 uri = /eip-gateways
24242024-12-21T05:50:08.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54903 req_id = 52df9261-ed22-478c-a6a6-17217f3b975d response_code = 204 uri = /vpc-routes
24252024-12-21T05:50:08.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33693
24262024-12-21T05:50:08.655ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24272024-12-21T05:50:08.696ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24282024-12-21T05:50:08.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101860 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33693 req_id = 49867905-5c0f-46b3-911f-bef8ea6b873f response_code = 204 uri = /switch-ports
24292024-12-21T05:50:08.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33693 req_id = 562dd804-59d0-4149-beda-f540ab68f4c2 response_code = 200 uri = /network-bootstore-config
24302024-12-21T05:50:12.238ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50287
24312024-12-21T05:50:12.238ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50287 req_id = e2832f80-de94-43ef-bb76-d93a870cef5f response_code = 200 uri = /baseboard
24322024-12-21T05:50:13.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62250
24332024-12-21T05:50:13.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62250 req_id = 38029eff-5466-4516-ade4-633747f936cc response_code = 200 uri = /vpc-routes
24342024-12-21T05:50:13.093ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
24352024-12-21T05:50:13.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62250 req_id = 47069d24-6ee8-4f7c-94e0-2b016e681af5 response_code = 204 uri = /eip-gateways
24362024-12-21T05:50:13.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62250 req_id = 4410b02a-36be-4ecc-b9d6-6923cf5afa78 response_code = 204 uri = /vpc-routes
24372024-12-21T05:50:13.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43715
24382024-12-21T05:50:13.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43715 req_id = e6352d5f-2c93-46aa-93be-895d5f831aba response_code = 200 uri = /v2p
24392024-12-21T05:50:13.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51423
24402024-12-21T05:50:13.194ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24412024-12-21T05:50:13.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24422024-12-21T05:50:13.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94433 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51423 req_id = 33cf7898-f93a-4707-9521-0db2c7f913bb response_code = 204 uri = /switch-ports
24432024-12-21T05:50:13.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51423 req_id = b5fc4e02-9b0f-4c18-92a9-4bc7aec79121 response_code = 200 uri = /network-bootstore-config
24442024-12-21T05:50:17.834ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7948 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = dee716f4-f4da-4756-b59e-6c8edf88ee49 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
24452024-12-21T05:50:38.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42480
24462024-12-21T05:50:38.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42480 req_id = 603eff78-3f3b-47c6-9d40-bc3c75cff9bc response_code = 200 uri = /vpc-routes
24472024-12-21T05:50:38.185ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
24482024-12-21T05:50:38.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42480 req_id = 6478d208-c2b2-4425-b7fc-a37d5be1b23b response_code = 204 uri = /eip-gateways
24492024-12-21T05:50:38.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42480 req_id = 447538b7-6ddf-400b-860e-ed5dddbf15d4 response_code = 204 uri = /vpc-routes
24502024-12-21T05:50:38.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53468
24512024-12-21T05:50:38.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53468 req_id = 1fd0c602-2b89-4ef7-9523-9532bcfd9aad response_code = 200 uri = /v2p
24522024-12-21T05:50:38.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43245
24532024-12-21T05:50:38.556ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24542024-12-21T05:50:38.595ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24552024-12-21T05:50:38.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94444 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43245 req_id = 2cb3eefb-332c-4f08-b219-0cf2554fc431 response_code = 204 uri = /switch-ports
24562024-12-21T05:50:38.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43245 req_id = e43ff632-ce7d-4f32-ab33-888909aa9848 response_code = 200 uri = /network-bootstore-config
24572024-12-21T05:50:38.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58358
24582024-12-21T05:50:38.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58358 req_id = 048a6494-be03-452d-8f18-d67ca0dcae7f response_code = 200 uri = /vpc-routes
24592024-12-21T05:50:38.763ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
24602024-12-21T05:50:38.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58358 req_id = 3203266f-07fa-48e6-b962-53d934943b63 response_code = 204 uri = /eip-gateways
24612024-12-21T05:50:38.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58358 req_id = 057646fe-c0af-457d-b4c0-5af24efa9d59 response_code = 204 uri = /vpc-routes
24622024-12-21T05:50:38.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55178
24632024-12-21T05:50:38.930ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24642024-12-21T05:50:38.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24652024-12-21T05:50:39.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98466 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55178 req_id = fe1fde84-ea62-48e7-8f14-54c985a428d9 response_code = 204 uri = /switch-ports
24662024-12-21T05:50:39.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37461
24672024-12-21T05:50:39.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37461 req_id = f8814c2f-f57b-4701-b214-8c3a55b034af response_code = 200 uri = /v2p
24682024-12-21T05:50:39.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55178 req_id = c362ca78-b06e-4184-9d82-d69142d7cfe1 response_code = 200 uri = /network-bootstore-config
24692024-12-21T05:50:42.270ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44318
24702024-12-21T05:50:42.270ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44318 req_id = 6896c2f6-3ddb-4e95-aae2-ba37777cb819 response_code = 200 uri = /baseboard
24712024-12-21T05:50:43.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48216
24722024-12-21T05:50:43.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48216 req_id = 0ab12059-8c9c-42e6-88d2-3fca5c3df6e7 response_code = 200 uri = /vpc-routes
24732024-12-21T05:50:43.230ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
24742024-12-21T05:50:43.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48216 req_id = 50a4ab4b-67aa-465f-9881-23c313209900 response_code = 204 uri = /eip-gateways
24752024-12-21T05:50:43.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48216 req_id = b3d512ea-c848-4314-9a63-66945f10653f response_code = 204 uri = /vpc-routes
24762024-12-21T05:50:43.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58957
24772024-12-21T05:50:43.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58957 req_id = f0aa33b1-0d42-4f71-aec2-3331935fc3bf response_code = 200 uri = /v2p
24782024-12-21T05:50:43.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51665
24792024-12-21T05:50:43.331ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24802024-12-21T05:50:43.372ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24812024-12-21T05:50:43.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95543 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51665 req_id = 8dc5e9ba-066f-4e8d-8018-c6b5cb0c7d0e response_code = 204 uri = /switch-ports
24822024-12-21T05:50:43.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51665 req_id = 9eec8b48-f7b0-4f7d-9375-46070c6027d9 response_code = 200 uri = /network-bootstore-config
24832024-12-21T05:50:47.834ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7573 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 17a26d68-3ba4-4493-8bcc-72781dd05895 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
24842024-12-21T05:51:08.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60379
24852024-12-21T05:51:08.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60379 req_id = 84449308-1311-4334-b611-626376621aa7 response_code = 200 uri = /vpc-routes
24862024-12-21T05:51:08.131ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
24872024-12-21T05:51:08.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60379 req_id = 0f19c137-0906-4e60-ad9f-e81bb0372b3b response_code = 204 uri = /eip-gateways
24882024-12-21T05:51:08.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60379 req_id = 0d7e610b-d58a-4afb-b67b-75b077b236d3 response_code = 204 uri = /vpc-routes
24892024-12-21T05:51:08.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43398
24902024-12-21T05:51:08.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43398 req_id = e1e19af4-bcc2-494e-995e-7a1f96cd09fe response_code = 200 uri = /v2p
24912024-12-21T05:51:08.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42416
24922024-12-21T05:51:08.256ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24932024-12-21T05:51:08.301ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24942024-12-21T05:51:08.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110867 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42416 req_id = ac99c4f7-941f-4c71-8a2d-bf787309b3db response_code = 204 uri = /switch-ports
24952024-12-21T05:51:08.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42416 req_id = 15272229-4716-4812-a56f-25f13515e73a response_code = 200 uri = /network-bootstore-config
24962024-12-21T05:51:08.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48658
24972024-12-21T05:51:08.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48658 req_id = 79c27e20-ed6f-4029-a3e2-43e5e7696ce2 response_code = 200 uri = /vpc-routes
24982024-12-21T05:51:08.671ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
24992024-12-21T05:51:08.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48658 req_id = 3989e8cf-5c2f-48e2-94db-7f27d51813b7 response_code = 204 uri = /eip-gateways
25002024-12-21T05:51:08.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48658 req_id = 6d78c0cf-e52d-4a54-8150-32fcc5f4f719 response_code = 204 uri = /vpc-routes
25012024-12-21T05:51:08.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46918
25022024-12-21T05:51:08.716ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25032024-12-21T05:51:08.754ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25042024-12-21T05:51:08.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97850 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46918 req_id = b2914795-2121-4b37-a10d-572779cf4c2f response_code = 204 uri = /switch-ports
25052024-12-21T05:51:08.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46918 req_id = 2bbf33bf-65a8-4407-8c9c-e52b5c397b73 response_code = 200 uri = /network-bootstore-config
25062024-12-21T05:51:08.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32815
25072024-12-21T05:51:08.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32815 req_id = e36c149c-39b5-411d-af9a-7732bbc2fe15 response_code = 200 uri = /v2p
25082024-12-21T05:51:12.304ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61508
25092024-12-21T05:51:12.304ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61508 req_id = d2134377-3009-4e65-acbb-35b0f6eb425f response_code = 200 uri = /baseboard
25102024-12-21T05:51:13.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36482
25112024-12-21T05:51:13.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36482 req_id = d920f518-145d-430c-b8a9-d91a591a2e04 response_code = 200 uri = /vpc-routes
25122024-12-21T05:51:13.173ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
25132024-12-21T05:51:13.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36482 req_id = 3b361c69-d8a3-42f0-b76a-4f0c6a8d81a7 response_code = 204 uri = /eip-gateways
25142024-12-21T05:51:13.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36482 req_id = 5d7b609d-e534-4af1-ab00-75d8c9a5e63c response_code = 204 uri = /vpc-routes
25152024-12-21T05:51:13.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39986
25162024-12-21T05:51:13.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39986 req_id = 0907fc6a-b977-48cc-86b8-75cca3669327 response_code = 200 uri = /v2p
25172024-12-21T05:51:13.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61372
25182024-12-21T05:51:13.309ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25192024-12-21T05:51:13.349ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25202024-12-21T05:51:13.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96072 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61372 req_id = 857c251b-a2d2-43ca-b313-a861fe143cda response_code = 204 uri = /switch-ports
25212024-12-21T05:51:13.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61372 req_id = 4f2fed3e-e00d-4cf9-917e-420c297ee84d response_code = 200 uri = /network-bootstore-config
25222024-12-21T05:51:16.723ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
25232024-12-21T05:51:16.723ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25242024-12-21T05:51:16.753ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1822, tv_nsec: 171145595 } time_to_next_cleanup = 599.99999556s
25252024-12-21T05:51:17.833ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6920 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = d19fe844-18ad-4900-b717-6768a6e77a55 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
25262024-12-21T05:51:30.724ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
25272024-12-21T05:51:38.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36136
25282024-12-21T05:51:38.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36136 req_id = 668b430f-27d6-47ad-8ef6-6d79bd24a8b8 response_code = 200 uri = /vpc-routes
25292024-12-21T05:51:38.436ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
25302024-12-21T05:51:38.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36136 req_id = b3339ea8-5e2e-4197-bced-4200154ef20f response_code = 204 uri = /eip-gateways
25312024-12-21T05:51:38.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36136 req_id = 9271cd37-593e-4a66-8788-2bf583ae802c response_code = 204 uri = /vpc-routes
25322024-12-21T05:51:38.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42040
25332024-12-21T05:51:38.537ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25342024-12-21T05:51:38.578ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25352024-12-21T05:51:38.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100019 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42040 req_id = 43c748b6-13a2-4015-bd27-f39ca1aafdbf response_code = 204 uri = /switch-ports
25362024-12-21T05:51:38.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64148
25372024-12-21T05:51:38.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38720
25382024-12-21T05:51:38.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38720 req_id = a7a1e205-5aa0-4c41-99a3-14394312236d response_code = 200 uri = /vpc-routes
25392024-12-21T05:51:38.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42040 req_id = 04a8962c-943e-4480-97f4-c6d4c205f63b response_code = 200 uri = /network-bootstore-config
25402024-12-21T05:51:38.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64148 req_id = 09b4cbf3-28ac-4328-8ff9-5f201486cbc5 response_code = 200 uri = /v2p
25412024-12-21T05:51:38.684ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
25422024-12-21T05:51:38.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38720 req_id = e6cd8122-dbbc-4c46-a4dc-b6b8dc0e19cb response_code = 204 uri = /eip-gateways
25432024-12-21T05:51:38.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38720 req_id = 582cce4b-5005-4533-95cc-2e6a98f51bc9 response_code = 204 uri = /vpc-routes
25442024-12-21T05:51:38.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35786
25452024-12-21T05:51:38.835ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25462024-12-21T05:51:38.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25472024-12-21T05:51:38.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95654 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35786 req_id = 4f7e1b11-fabb-4a5f-a7b2-aac5618ea1b2 response_code = 204 uri = /switch-ports
25482024-12-21T05:51:38.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49264
25492024-12-21T05:51:38.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49264 req_id = 2e804cef-f922-4d71-a179-7d297eb3adfc response_code = 200 uri = /v2p
25502024-12-21T05:51:38.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35786 req_id = 34dd5575-067a-48d0-9362-bf72b5f68ecb response_code = 200 uri = /network-bootstore-config
25512024-12-21T05:51:42.336ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42131
25522024-12-21T05:51:42.336ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42131 req_id = 8c513566-055b-4162-9b8a-55a1dfa813d8 response_code = 200 uri = /baseboard
25532024-12-21T05:51:43.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58770
25542024-12-21T05:51:43.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58770 req_id = 9bdadbba-7670-4f6a-a141-f3eaa64b62c9 response_code = 200 uri = /v2p
25552024-12-21T05:51:43.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46733
25562024-12-21T05:51:43.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46733 req_id = f481bd53-d334-4270-835f-2030ca6a62e3 response_code = 200 uri = /vpc-routes
25572024-12-21T05:51:43.393ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
25582024-12-21T05:51:43.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46733 req_id = 3721bdab-7136-4f93-9e42-2a97bbff405e response_code = 204 uri = /eip-gateways
25592024-12-21T05:51:43.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46733 req_id = 57f8bbcf-8e35-42f1-939e-011fe4cfb7bd response_code = 204 uri = /vpc-routes
25602024-12-21T05:51:43.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57291
25612024-12-21T05:51:43.446ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25622024-12-21T05:51:43.486ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25632024-12-21T05:51:43.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57291 req_id = 33a91929-813e-4813-9d2c-5cd43f02249d response_code = 204 uri = /switch-ports
25642024-12-21T05:51:43.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57291 req_id = c88f385d-bb37-4fe9-a093-c37072020478 response_code = 200 uri = /network-bootstore-config
25652024-12-21T05:51:47.833ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7388 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 9cefcce1-bf45-49b1-8588-a89bd71c957f response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
25662024-12-21T05:52:08.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51256
25672024-12-21T05:52:08.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51256 req_id = b79cb3e1-5241-42e4-a04a-274828d5d131 response_code = 200 uri = /vpc-routes
25682024-12-21T05:52:08.128ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
25692024-12-21T05:52:08.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51256 req_id = 353d289b-b8ae-4f34-9686-6a799ba09f81 response_code = 204 uri = /eip-gateways
25702024-12-21T05:52:08.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51256 req_id = fae90a33-dd6b-450c-a2ee-43adb02e296c response_code = 204 uri = /vpc-routes
25712024-12-21T05:52:08.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47882
25722024-12-21T05:52:08.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47882 req_id = b2a9c1a3-fc02-49e3-88f5-3af743f4f9ce response_code = 200 uri = /v2p
25732024-12-21T05:52:08.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64552
25742024-12-21T05:52:08.292ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25752024-12-21T05:52:08.333ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25762024-12-21T05:52:08.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129856 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64552 req_id = a3f7d747-cf85-479d-a03d-5f980f5190b1 response_code = 204 uri = /switch-ports
25772024-12-21T05:52:08.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64552 req_id = 0abfd8ea-d5d3-4907-a43f-875e63f2814b response_code = 200 uri = /network-bootstore-config
25782024-12-21T05:52:08.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46450
25792024-12-21T05:52:08.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46450 req_id = f29eca81-f489-413f-8b5a-cb74f31c7f41 response_code = 200 uri = /vpc-routes
25802024-12-21T05:52:08.577ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
25812024-12-21T05:52:08.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46450 req_id = abf8b991-c150-4eb8-bdbf-63ea6576e344 response_code = 204 uri = /eip-gateways
25822024-12-21T05:52:08.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46450 req_id = cfc9556c-1985-49c5-adf7-f67c7ab2cd37 response_code = 204 uri = /vpc-routes
25832024-12-21T05:52:08.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54200
25842024-12-21T05:52:08.598ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25852024-12-21T05:52:08.637ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25862024-12-21T05:52:08.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102324 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54200 req_id = cd6e6c8d-e5df-4c7f-8744-8d427bddb7b1 response_code = 204 uri = /switch-ports
25872024-12-21T05:52:08.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61816
25882024-12-21T05:52:08.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61816 req_id = 114eee42-2312-4e20-996e-da5d343b8457 response_code = 200 uri = /v2p
25892024-12-21T05:52:08.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54200 req_id = aa1dcbc2-f6ed-45c3-83a9-691d1b9cbf62 response_code = 200 uri = /network-bootstore-config
25902024-12-21T05:52:12.368ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51364
25912024-12-21T05:52:12.368ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51364 req_id = c99a7830-50a5-434a-b48a-d90ea0453b53 response_code = 200 uri = /baseboard
25922024-12-21T05:52:13.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62785
25932024-12-21T05:52:13.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62785 req_id = 3a3f06a8-2ec2-4f2f-b501-6ed39c6e9a91 response_code = 200 uri = /vpc-routes
25942024-12-21T05:52:13.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45964
25952024-12-21T05:52:13.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45964 req_id = cd5704a4-0e0d-48b7-80e7-e12a40aa262e response_code = 200 uri = /v2p
25962024-12-21T05:52:13.169ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
25972024-12-21T05:52:13.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62785 req_id = 9e47d134-8f9f-4140-a3ea-13610db7b766 response_code = 204 uri = /eip-gateways
25982024-12-21T05:52:13.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62785 req_id = 319ee42b-8e71-4d59-866f-300ca614bc15 response_code = 204 uri = /vpc-routes
25992024-12-21T05:52:13.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33985
26002024-12-21T05:52:13.205ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26012024-12-21T05:52:13.246ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26022024-12-21T05:52:13.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33985 req_id = a9d3e3cb-f862-4033-97a4-7e7f45edbe0d response_code = 204 uri = /switch-ports
26032024-12-21T05:52:13.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33985 req_id = c3d7ba6c-c92d-4a5d-aff6-5319434068a0 response_code = 200 uri = /network-bootstore-config
26042024-12-21T05:52:17.833ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7112 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = a87eee53-88b2-4228-b399-4793bb749ceb response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
26052024-12-21T05:52:38.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53155
26062024-12-21T05:52:38.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53155 req_id = 8e6a064e-ccd0-4192-9624-d03759a1989f response_code = 200 uri = /vpc-routes
26072024-12-21T05:52:38.197ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
26082024-12-21T05:52:38.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53155 req_id = 92d30765-89da-448f-97e8-6814076b04ec response_code = 204 uri = /eip-gateways
26092024-12-21T05:52:38.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56555
26102024-12-21T05:52:38.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56555 req_id = 6434435e-90b5-4ad8-86fa-c7990e615b73 response_code = 200 uri = /v2p
26112024-12-21T05:52:38.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53155 req_id = 38218c52-c3c0-4f8c-aa5c-93a51c654389 response_code = 204 uri = /vpc-routes
26122024-12-21T05:52:38.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61054
26132024-12-21T05:52:38.319ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26142024-12-21T05:52:38.367ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26152024-12-21T05:52:38.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138769 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61054 req_id = b85f34f6-ec4e-442f-b10a-0bcbecf452ec response_code = 204 uri = /switch-ports
26162024-12-21T05:52:38.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61054 req_id = 76222f7b-6da0-43f0-9d71-8fa0cc6d95b4 response_code = 200 uri = /network-bootstore-config
26172024-12-21T05:52:38.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62328
26182024-12-21T05:52:38.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62328 req_id = af2cf4ff-d923-4ed2-b1e1-bf442287ec24 response_code = 200 uri = /vpc-routes
26192024-12-21T05:52:38.698ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
26202024-12-21T05:52:38.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62328 req_id = 5c9f3d87-62d9-4b94-a360-db63ff547bd6 response_code = 204 uri = /eip-gateways
26212024-12-21T05:52:38.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35292
26222024-12-21T05:52:38.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35292 req_id = ca859304-02d8-4aa0-9d76-80b5bd2ee79c response_code = 200 uri = /v2p
26232024-12-21T05:52:38.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62328 req_id = 8df2bf14-0ec2-42b8-95a1-7656ef071556 response_code = 204 uri = /vpc-routes
26242024-12-21T05:52:38.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38926
26252024-12-21T05:52:38.850ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26262024-12-21T05:52:38.889ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26272024-12-21T05:52:38.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96941 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38926 req_id = 67c51410-e4c3-4f52-b0ed-5522c6010b06 response_code = 204 uri = /switch-ports
26282024-12-21T05:52:38.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38926 req_id = 394a52d8-550f-4208-ae31-29d3d41dca29 response_code = 200 uri = /network-bootstore-config
26292024-12-21T05:52:42.400ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61015
26302024-12-21T05:52:42.400ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61015 req_id = 0e3d14ec-6d6d-427d-a7f3-59a6121709a1 response_code = 200 uri = /baseboard
26312024-12-21T05:52:43.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60414
26322024-12-21T05:52:43.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60414 req_id = 89c0f093-ee12-4bce-998a-cc4c9fc0fce8 response_code = 200 uri = /vpc-routes
26332024-12-21T05:52:43.362ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
26342024-12-21T05:52:43.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60414 req_id = 20068046-7497-487b-8dfb-70f61f2e0afe response_code = 204 uri = /eip-gateways
26352024-12-21T05:52:43.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60414 req_id = a43c0dfc-d6fe-4acc-b741-31f8e499f7f8 response_code = 204 uri = /vpc-routes
26362024-12-21T05:52:43.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33552
26372024-12-21T05:52:43.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33552 req_id = 979f9a60-150d-4bd2-8681-34d42cf7abab response_code = 200 uri = /v2p
26382024-12-21T05:52:43.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34535
26392024-12-21T05:52:43.502ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26402024-12-21T05:52:43.542ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26412024-12-21T05:52:43.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98749 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34535 req_id = 5a33786a-1f3e-4d4d-84ef-bfb0319df20d response_code = 204 uri = /switch-ports
26422024-12-21T05:52:43.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34535 req_id = 6959ab2f-b043-404c-a29f-a9fcb4f7edd1 response_code = 200 uri = /network-bootstore-config
26432024-12-21T05:52:47.833ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7382 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = ab3b61df-1da0-4901-a711-edc5bf0cb2fe response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
26442024-12-21T05:53:08.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52318
26452024-12-21T05:53:08.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52318 req_id = 13d7553d-56c5-4a59-bded-a7cc49b2dd88 response_code = 200 uri = /vpc-routes
26462024-12-21T05:53:08.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39995
26472024-12-21T05:53:08.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39995 req_id = b1b645c0-063f-4c7d-a776-d6a55ae390df response_code = 200 uri = /v2p
26482024-12-21T05:53:08.137ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
26492024-12-21T05:53:08.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52318 req_id = 485301e2-7e69-4c35-a7c8-3bd93b5295e3 response_code = 204 uri = /eip-gateways
26502024-12-21T05:53:08.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52318 req_id = bf635894-a26d-4987-a1fb-f101380ff233 response_code = 204 uri = /vpc-routes
26512024-12-21T05:53:08.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61668
26522024-12-21T05:53:08.160ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26532024-12-21T05:53:08.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26542024-12-21T05:53:08.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96866 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61668 req_id = df76fdc6-e3c5-44c1-863b-df16a4c738f3 response_code = 204 uri = /switch-ports
26552024-12-21T05:53:08.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61668 req_id = d8a273af-e63b-4ee0-b326-a80642cea2ea response_code = 200 uri = /network-bootstore-config
26562024-12-21T05:53:08.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36006
26572024-12-21T05:53:08.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36006 req_id = 665ec04c-a3e4-47fc-a724-dc322eb73160 response_code = 200 uri = /vpc-routes
26582024-12-21T05:53:08.552ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
26592024-12-21T05:53:08.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36006 req_id = cc9c6bfd-c787-4bad-9393-f56ee35a403c response_code = 204 uri = /eip-gateways
26602024-12-21T05:53:08.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39733
26612024-12-21T05:53:08.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39733 req_id = 3a05c594-67eb-4635-8c92-4fd49cf754c6 response_code = 200 uri = /v2p
26622024-12-21T05:53:08.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36006 req_id = a5c008fa-b028-4429-9ac3-79559933cc8d response_code = 204 uri = /vpc-routes
26632024-12-21T05:53:08.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38764
26642024-12-21T05:53:08.773ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26652024-12-21T05:53:08.812ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26662024-12-21T05:53:08.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96451 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38764 req_id = e57d6eaf-e2a6-460b-af65-0869b5acd55c response_code = 204 uri = /switch-ports
26672024-12-21T05:53:08.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38764 req_id = df2d3893-c0f5-4127-b1d1-107668bf611b response_code = 200 uri = /network-bootstore-config
26682024-12-21T05:53:12.433ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62077
26692024-12-21T05:53:12.433ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62077 req_id = de171284-6326-4a8d-a207-c6a2f4cdd633 response_code = 200 uri = /baseboard
26702024-12-21T05:53:13.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41056
26712024-12-21T05:53:13.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41056 req_id = 2aa778bf-4f71-470e-868b-6ee211f66124 response_code = 200 uri = /vpc-routes
26722024-12-21T05:53:13.206ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
26732024-12-21T05:53:13.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41056 req_id = fb8b87e9-702b-4fc6-a93d-adfbeba7802c response_code = 204 uri = /eip-gateways
26742024-12-21T05:53:13.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41056 req_id = d31fbd7a-1db0-4f1f-922f-13d3c506f4ad response_code = 204 uri = /vpc-routes
26752024-12-21T05:53:13.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51346
26762024-12-21T05:53:13.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51346 req_id = b515a0d9-47d1-426f-a513-5661f58e589d response_code = 200 uri = /v2p
26772024-12-21T05:53:13.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58141
26782024-12-21T05:53:13.347ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26792024-12-21T05:53:13.386ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26802024-12-21T05:53:13.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94478 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58141 req_id = 3224c071-1915-4420-92af-8f732c25eb15 response_code = 204 uri = /switch-ports
26812024-12-21T05:53:13.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58141 req_id = 5a62f251-923a-4ec9-a4e5-57f76765cbb0 response_code = 200 uri = /network-bootstore-config
26822024-12-21T05:53:17.833ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7816 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 0c72d3d9-907b-464d-b762-172ba29e0444 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
26832024-12-21T05:53:38.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34324
26842024-12-21T05:53:38.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34324 req_id = b0c3dcf2-96c5-4116-b54b-4200483dad72 response_code = 200 uri = /vpc-routes
26852024-12-21T05:53:38.154ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
26862024-12-21T05:53:38.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34324 req_id = ec52c6ac-08dc-4849-a7a3-73063447ff2f response_code = 204 uri = /eip-gateways
26872024-12-21T05:53:38.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34324 req_id = 8de8f51b-1730-45da-afce-12f1b273a401 response_code = 204 uri = /vpc-routes
26882024-12-21T05:53:38.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57627
26892024-12-21T05:53:38.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57627 req_id = 14cb7638-bc13-4152-85fd-92c160e29dbe response_code = 200 uri = /v2p
26902024-12-21T05:53:38.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36030
26912024-12-21T05:53:38.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26922024-12-21T05:53:38.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26932024-12-21T05:53:38.533ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-zones.json file = common/src/ledger.rs:177
26942024-12-21T05:53:38.533ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-zones.json file = common/src/ledger.rs:177
26952024-12-21T05:53:38.550ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26962024-12-21T05:53:38.550ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7912c084-27e1-426d-a3ef-7d0f642d9382
26972024-12-21T05:53:38.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63949
26982024-12-21T05:53:38.568ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26992024-12-21T05:53:38.586ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27002024-12-21T05:53:38.586ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3351d590-858e-45b6-91ff-51f0d9e17995
27012024-12-21T05:53:38.609ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27022024-12-21T05:53:38.614ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27032024-12-21T05:53:38.614ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_871c983c-3586-410a-849e-2f5b0cbe8e62
27042024-12-21T05:53:38.646ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27052024-12-21T05:53:38.646ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a
27062024-12-21T05:53:38.675ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27072024-12-21T05:53:38.675ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722
27082024-12-21T05:53:38.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114566 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63949 req_id = fbca5763-8e7b-4723-be9d-c2f0f09a67c8 response_code = 204 uri = /switch-ports
27092024-12-21T05:53:38.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63949 req_id = 0c7cd01a-86fe-4d6c-b414-9da3f0180147 response_code = 200 uri = /network-bootstore-config
27102024-12-21T05:53:38.702ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27112024-12-21T05:53:38.702ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb
27122024-12-21T05:53:38.727ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27132024-12-21T05:53:38.727ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9
27142024-12-21T05:53:38.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52182
27152024-12-21T05:53:38.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52182 req_id = 05eab351-b6ea-4a79-a462-f3c75e741c73 response_code = 200 uri = /vpc-routes
27162024-12-21T05:53:38.750ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27172024-12-21T05:53:38.750ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0
27182024-12-21T05:53:38.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64297
27192024-12-21T05:53:38.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64297 req_id = 9c52db50-7350-4c57-940d-5f76b0fbcbe6 response_code = 200 uri = /v2p
27202024-12-21T05:53:38.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53508
27212024-12-21T05:53:38.756ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 57b78e12-2ea9-463d-a689-565344dffa73, kind: Service { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa }, name: Name("external-dns-284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 59])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7068213c-a7cd-4f1b-b697-368276e5ea37, kind: Service { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 }, name: Name("external-dns-5f5da623-23f2-4e2f-b423-7097e8481e49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ad27df-342d-495e-a4af-9b1bd7ef97af, kind: Service { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de }, name: Name("nexus-ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2186fc88-ccae-445f-be44-94dc147f97b5, kind: Service { id: b381127d-ac24-4ced-abe2-28a1272fd710 }, name: Name("nexus-b381127d-ac24-4ced-abe2-28a1272fd710"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3a266615-9b66-4a87-93bc-6f160dec5481, kind: Service { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 }, name: Name("nexus-4c5d0e65-66c8-4b42-9538-d497e5b523f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27222024-12-21T05:53:38.756ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27232024-12-21T05:53:38.756ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27242024-12-21T05:53:38.756ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27252024-12-21T05:53:38.756ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27262024-12-21T05:53:38.756ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27272024-12-21T05:53:38.756ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27282024-12-21T05:53:38.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 420 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53508 req_id = c557df1c-d3e5-4151-9873-4ab2c972d75f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27292024-12-21T05:53:38.773ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27302024-12-21T05:53:38.774ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa625e73-0c39-487d-9929-b234b9ea83f9
27312024-12-21T05:53:38.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258915 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36030 req_id = 1e7978cf-fbe7-444d-ad97-1cb3817398b1 response_code = 200 uri = /inventory
27322024-12-21T05:53:38.801ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
27332024-12-21T05:53:38.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52182 req_id = d6f9c6ef-57a4-4453-b4eb-7643f06dc428 response_code = 204 uri = /eip-gateways
27342024-12-21T05:53:38.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52182 req_id = 4a23f8fa-cfd9-40b1-8d2d-06c3540eeea7 response_code = 204 uri = /vpc-routes
27352024-12-21T05:53:38.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43996
27362024-12-21T05:53:38.896ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27372024-12-21T05:53:38.896ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27382024-12-21T05:53:38.896ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-zones.json file = common/src/ledger.rs:177
27392024-12-21T05:53:38.896ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-zones.json file = common/src/ledger.rs:177
27402024-12-21T05:53:38.909ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27412024-12-21T05:53:38.909ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7912c084-27e1-426d-a3ef-7d0f642d9382
27422024-12-21T05:53:38.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51069
27432024-12-21T05:53:38.920ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27442024-12-21T05:53:38.943ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27452024-12-21T05:53:38.943ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3351d590-858e-45b6-91ff-51f0d9e17995
27462024-12-21T05:53:38.965ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27472024-12-21T05:53:38.973ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27482024-12-21T05:53:38.973ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_871c983c-3586-410a-849e-2f5b0cbe8e62
27492024-12-21T05:53:39.002ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27502024-12-21T05:53:39.002ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a
27512024-12-21T05:53:39.027ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27522024-12-21T05:53:39.027ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722
27532024-12-21T05:53:39.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115707 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51069 req_id = 6bf75015-d11c-486b-a2cb-603b3db35655 response_code = 204 uri = /switch-ports
27542024-12-21T05:53:39.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51069 req_id = d9552c02-2054-49be-96d3-7158ccd49c1a response_code = 200 uri = /network-bootstore-config
27552024-12-21T05:53:39.053ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27562024-12-21T05:53:39.053ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb
27572024-12-21T05:53:39.077ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27582024-12-21T05:53:39.077ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9
27592024-12-21T05:53:39.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61831
27602024-12-21T05:53:39.083ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 57b78e12-2ea9-463d-a689-565344dffa73, kind: Service { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa }, name: Name("external-dns-284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 59])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7068213c-a7cd-4f1b-b697-368276e5ea37, kind: Service { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 }, name: Name("external-dns-5f5da623-23f2-4e2f-b423-7097e8481e49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ad27df-342d-495e-a4af-9b1bd7ef97af, kind: Service { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de }, name: Name("nexus-ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2186fc88-ccae-445f-be44-94dc147f97b5, kind: Service { id: b381127d-ac24-4ced-abe2-28a1272fd710 }, name: Name("nexus-b381127d-ac24-4ced-abe2-28a1272fd710"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3a266615-9b66-4a87-93bc-6f160dec5481, kind: Service { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 }, name: Name("nexus-4c5d0e65-66c8-4b42-9538-d497e5b523f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27612024-12-21T05:53:39.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27622024-12-21T05:53:39.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27632024-12-21T05:53:39.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27642024-12-21T05:53:39.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27652024-12-21T05:53:39.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27662024-12-21T05:53:39.083ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27672024-12-21T05:53:39.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 349 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61831 req_id = f60fdd31-b0d7-4246-8cd7-1e61a0772180 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27682024-12-21T05:53:39.101ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27692024-12-21T05:53:39.101ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0
27702024-12-21T05:53:39.126ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27712024-12-21T05:53:39.126ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa625e73-0c39-487d-9929-b234b9ea83f9
27722024-12-21T05:53:39.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243915 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43996 req_id = 8525db54-ef5c-440f-923e-c6c14b4ffb3a response_code = 200 uri = /inventory
27732024-12-21T05:53:42.467ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45738
27742024-12-21T05:53:42.467ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45738 req_id = b309015b-c0d5-4284-bced-20ee73855184 response_code = 200 uri = /baseboard
27752024-12-21T05:53:43.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48317
27762024-12-21T05:53:43.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48317 req_id = 801f7b76-f2cb-489e-906e-f6a4c4759834 response_code = 200 uri = /vpc-routes
27772024-12-21T05:53:43.311ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
27782024-12-21T05:53:43.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48317 req_id = 841801ff-acbe-4fd8-8296-209733393100 response_code = 204 uri = /eip-gateways
27792024-12-21T05:53:43.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62610
27802024-12-21T05:53:43.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62610 req_id = 998f6beb-c9bc-4ce5-8d89-afad60a6dc9f response_code = 200 uri = /v2p
27812024-12-21T05:53:43.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48317 req_id = 36079fa0-b755-40ce-8859-b9a25c1212ff response_code = 204 uri = /vpc-routes
27822024-12-21T05:53:43.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36777
27832024-12-21T05:53:43.429ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27842024-12-21T05:53:43.429ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27852024-12-21T05:53:43.429ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/config/omicron-zones.json file = common/src/ledger.rs:177
27862024-12-21T05:53:43.429ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/config/omicron-zones.json file = common/src/ledger.rs:177
27872024-12-21T05:53:43.442ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7912c084-27e1-426d-a3ef-7d0f642d9382 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27882024-12-21T05:53:43.442ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7912c084-27e1-426d-a3ef-7d0f642d9382
27892024-12-21T05:53:43.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48182
27902024-12-21T05:53:43.453ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27912024-12-21T05:53:43.471ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3351d590-858e-45b6-91ff-51f0d9e17995 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27922024-12-21T05:53:43.471ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3351d590-858e-45b6-91ff-51f0d9e17995
27932024-12-21T05:53:43.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60099
27942024-12-21T05:53:43.494ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 57b78e12-2ea9-463d-a689-565344dffa73, kind: Service { id: 284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa }, name: Name("external-dns-284bdf0f-32cf-4c2f-b1af-3cfe30b62eaa"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 59])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7068213c-a7cd-4f1b-b697-368276e5ea37, kind: Service { id: 5f5da623-23f2-4e2f-b423-7097e8481e49 }, name: Name("external-dns-5f5da623-23f2-4e2f-b423-7097e8481e49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 3])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 08ad27df-342d-495e-a4af-9b1bd7ef97af, kind: Service { id: ac588187-c3ee-42b3-9cd7-09be6d4cd5de }, name: Name("nexus-ac588187-c3ee-42b3-9cd7-09be6d4cd5de"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2186fc88-ccae-445f-be44-94dc147f97b5, kind: Service { id: b381127d-ac24-4ced-abe2-28a1272fd710 }, name: Name("nexus-b381127d-ac24-4ced-abe2-28a1272fd710"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 171, 87])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3a266615-9b66-4a87-93bc-6f160dec5481, kind: Service { id: 4c5d0e65-66c8-4b42-9538-d497e5b523f9 }, name: Name("nexus-4c5d0e65-66c8-4b42-9538-d497e5b523f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27952024-12-21T05:53:43.494ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27962024-12-21T05:53:43.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27972024-12-21T05:53:43.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27982024-12-21T05:53:43.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27992024-12-21T05:53:43.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28002024-12-21T05:53:43.498ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28012024-12-21T05:53:43.498ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28022024-12-21T05:53:43.498ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 871c983c-3586-410a-849e-2f5b0cbe8e62 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28032024-12-21T05:53:43.498ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_871c983c-3586-410a-849e-2f5b0cbe8e62
28042024-12-21T05:53:43.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4414 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60099 req_id = 21874968-c9ec-4af4-985f-43f06defb759 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28052024-12-21T05:53:43.522ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bb3541f-3c91-4f12-b4ac-85be5075aa6a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28062024-12-21T05:53:43.522ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bb3541f-3c91-4f12-b4ac-85be5075aa6a
28072024-12-21T05:53:43.547ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 144378a5-cfc6-44e1-8dd6-f07860f0a722 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28082024-12-21T05:53:43.548ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_144378a5-cfc6-44e1-8dd6-f07860f0a722
28092024-12-21T05:53:43.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102858 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48182 req_id = 89482491-4082-4cbb-8c57-bd90701ec97f response_code = 204 uri = /switch-ports
28102024-12-21T05:53:43.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48182 req_id = 06a49b45-2841-4788-9b7b-06d5b55894b9 response_code = 200 uri = /network-bootstore-config
28112024-12-21T05:53:43.573ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: daf1d0a1-d6b9-49f1-9e21-7ba5091043cb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28122024-12-21T05:53:43.573ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_daf1d0a1-d6b9-49f1-9e21-7ba5091043cb
28132024-12-21T05:53:43.593ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eddbd6ad-6d1a-4b15-b651-c9b7507577a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28142024-12-21T05:53:43.594ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eddbd6ad-6d1a-4b15-b651-c9b7507577a9
28152024-12-21T05:53:43.617ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28162024-12-21T05:53:43.617ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0
28172024-12-21T05:53:43.640ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fa625e73-0c39-487d-9929-b234b9ea83f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28182024-12-21T05:53:43.640ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fa625e73-0c39-487d-9929-b234b9ea83f9
28192024-12-21T05:53:43.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225437 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36777 req_id = 12b052ba-43ff-4103-aa0e-38e97fddf593 response_code = 200 uri = /inventory
28202024-12-21T05:53:47.835ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9463 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = cf4e3a61-c844-401f-be1d-a2322c38e88b response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
28212024-12-21T05:54:08.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63613
28222024-12-21T05:54:08.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63613 req_id = db973eff-7960-4215-a18e-5c4a6a963dd5 response_code = 200 uri = /vpc-routes
28232024-12-21T05:54:08.060ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
28242024-12-21T05:54:08.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63613 req_id = 9ddc579a-45ce-4f43-9f1b-d913deb2fa6b response_code = 204 uri = /eip-gateways
28252024-12-21T05:54:08.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58662
28262024-12-21T05:54:08.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58662 req_id = ebc402ad-41f5-486f-9b53-42ef2b8959d8 response_code = 200 uri = /v2p
28272024-12-21T05:54:08.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63613 req_id = 4d1dc52a-3697-453b-8fa0-812fa8ce19f6 response_code = 204 uri = /vpc-routes
28282024-12-21T05:54:08.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53137
28292024-12-21T05:54:08.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28302024-12-21T05:54:08.193ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28312024-12-21T05:54:08.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91178 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53137 req_id = 22256320-4d86-4141-934c-6af7b064837b response_code = 204 uri = /switch-ports
28322024-12-21T05:54:08.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53137 req_id = 4859b951-4fee-427d-bb03-5ef0cd3e27bb response_code = 200 uri = /network-bootstore-config
28332024-12-21T05:54:08.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47351
28342024-12-21T05:54:08.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47351 req_id = 803ca03a-3cee-4a76-a99b-064bd357a495 response_code = 200 uri = /vpc-routes
28352024-12-21T05:54:08.520ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
28362024-12-21T05:54:08.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47351 req_id = 37b9f71d-981c-44b2-90a7-b729db27ecab response_code = 204 uri = /eip-gateways
28372024-12-21T05:54:08.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47351 req_id = 30bc5d97-aa99-4eea-b328-ae42fb9e3130 response_code = 204 uri = /vpc-routes
28382024-12-21T05:54:08.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35119
28392024-12-21T05:54:08.615ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28402024-12-21T05:54:08.655ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28412024-12-21T05:54:08.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99808 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35119 req_id = 509b6572-17e9-4013-9be8-9747bef8e12e response_code = 204 uri = /switch-ports
28422024-12-21T05:54:08.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54826
28432024-12-21T05:54:08.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54826 req_id = 5d56a32f-9e78-4f74-8a00-0fc32c67ae04 response_code = 200 uri = /v2p
28442024-12-21T05:54:08.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35119 req_id = 3bcc8258-2ad8-41d3-b494-a33aeae021ae response_code = 200 uri = /network-bootstore-config
28452024-12-21T05:54:12.498ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60533
28462024-12-21T05:54:12.498ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60533 req_id = 2c74a496-a696-44e6-92bc-fd46eac14f7b response_code = 200 uri = /baseboard
28472024-12-21T05:54:13.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34090
28482024-12-21T05:54:13.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34090 req_id = e3aec5cb-8d0f-467d-8ed3-6f620bd4d4a8 response_code = 200 uri = /vpc-routes
28492024-12-21T05:54:13.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
28502024-12-21T05:54:13.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34090 req_id = fc0a3678-9035-4c9d-91ae-1b2db7a07610 response_code = 204 uri = /eip-gateways
28512024-12-21T05:54:13.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34090 req_id = 7ad05e82-a294-4a15-b2ba-4d2422fad3b9 response_code = 204 uri = /vpc-routes
28522024-12-21T05:54:13.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63392
28532024-12-21T05:54:13.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63392 req_id = 4750bc32-c5bd-4d5f-ae10-14af74ef29da response_code = 200 uri = /v2p
28542024-12-21T05:54:13.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39700
28552024-12-21T05:54:13.307ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28562024-12-21T05:54:13.345ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28572024-12-21T05:54:13.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99928 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39700 req_id = 7f42d792-eaff-4621-87de-b0603f686fe8 response_code = 204 uri = /switch-ports
28582024-12-21T05:54:13.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39700 req_id = 7d36d360-6e32-4978-bb65-9b78da306617 response_code = 200 uri = /network-bootstore-config
28592024-12-21T05:54:17.832ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7355 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = d7d60160-c141-44b7-b38e-74fde61c881b response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
28602024-12-21T05:54:38.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56336
28612024-12-21T05:54:38.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56336 req_id = de0bfbdd-9e8d-4ada-b9ca-453d09e4c1e6 response_code = 200 uri = /vpc-routes
28622024-12-21T05:54:38.259ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
28632024-12-21T05:54:38.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56336 req_id = f4c8e666-d9e6-4ac2-a319-9ebfcf7391d0 response_code = 204 uri = /eip-gateways
28642024-12-21T05:54:38.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56336 req_id = 3f437bcc-9917-4d36-9835-d2e122896754 response_code = 204 uri = /vpc-routes
28652024-12-21T05:54:38.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39601
28662024-12-21T05:54:38.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39601 req_id = 4f7d1224-a67d-4a67-8ee0-138ac4d5b026 response_code = 200 uri = /v2p
28672024-12-21T05:54:38.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32790
28682024-12-21T05:54:38.566ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28692024-12-21T05:54:38.606ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28702024-12-21T05:54:38.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101043 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32790 req_id = 7d5477c4-aee0-41d5-a7e5-46ee936103b9 response_code = 204 uri = /switch-ports
28712024-12-21T05:54:38.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32790 req_id = 66898480-7b7f-4448-9f6a-ce8b005e8b41 response_code = 200 uri = /network-bootstore-config
28722024-12-21T05:54:38.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63103
28732024-12-21T05:54:38.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63103 req_id = d4d2cfea-a194-4ab8-851a-d9dadf536724 response_code = 200 uri = /vpc-routes
28742024-12-21T05:54:38.696ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
28752024-12-21T05:54:38.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63103 req_id = 8b4b30f7-bf27-4834-9367-c95b3e78943f response_code = 204 uri = /eip-gateways
28762024-12-21T05:54:38.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37358
28772024-12-21T05:54:38.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37358 req_id = afdadd8a-45e7-4989-819c-8f345da9a3f9 response_code = 200 uri = /v2p
28782024-12-21T05:54:38.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63103 req_id = d94fa988-9695-4144-aa15-f93f8860bebc response_code = 204 uri = /vpc-routes
28792024-12-21T05:54:38.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37259
28802024-12-21T05:54:38.802ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28812024-12-21T05:54:38.841ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28822024-12-21T05:54:38.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37259 req_id = b3a95d6f-626d-4777-ba64-6bd8ac0ff90d response_code = 204 uri = /switch-ports
28832024-12-21T05:54:38.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37259 req_id = 068d9c5d-717b-4f1d-833d-136694f03bd9 response_code = 200 uri = /network-bootstore-config
28842024-12-21T05:54:42.532ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61269
28852024-12-21T05:54:42.532ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61269 req_id = 9aabfaf4-08b7-4dde-aa0e-06fbfb53914c response_code = 200 uri = /baseboard
28862024-12-21T05:54:43.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49763
28872024-12-21T05:54:43.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49763 req_id = 78cd8f6e-acbc-4620-ba2e-de11193ccf4f response_code = 200 uri = /vpc-routes
28882024-12-21T05:54:43.358ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
28892024-12-21T05:54:43.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49763 req_id = d1106ad0-2470-4318-ad37-36a4aef81834 response_code = 204 uri = /eip-gateways
28902024-12-21T05:54:43.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49763 req_id = 578f9164-6b64-4e5f-a1a5-65fed9db906d response_code = 204 uri = /vpc-routes
28912024-12-21T05:54:43.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50793
28922024-12-21T05:54:43.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50793 req_id = dff5e05d-f520-44be-9486-cbfcccff720e response_code = 200 uri = /v2p
28932024-12-21T05:54:43.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37320
28942024-12-21T05:54:43.499ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28952024-12-21T05:54:43.539ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28962024-12-21T05:54:43.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97685 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37320 req_id = 7fcefba1-c0f3-41ee-8dc0-a3f2adc07377 response_code = 204 uri = /switch-ports
28972024-12-21T05:54:43.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37320 req_id = 98d07225-8e69-4bec-a073-3dbadd4d12f8 response_code = 200 uri = /network-bootstore-config
28982024-12-21T05:54:47.834ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8631 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 716af402-d502-4e56-ad52-7ce0b8ad26c8 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
28992024-12-21T05:55:01.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54428
29002024-12-21T05:55:01.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54428 req_id = 9f29b36c-0685-41ab-8fd2-040005ac5932 response_code = 200 uri = /v2p
29012024-12-21T05:55:01.153ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(3498081) }
29022024-12-21T05:55:01.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54428 req_id = 134422d2-1e22-48ac-afd3-74fe767592a1 response_code = 204 uri = /v2p
29032024-12-21T05:55:01.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63010
29042024-12-21T05:55:01.317ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 230cbb3f-fd82-41ff-b241-18559d2a8099, kind: Instance { id: 4c918145-f5b2-4879-b176-6a46c3dfa233 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3498081), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 230cbb3f-fd82-41ff-b241-18559d2a8099, kind: Instance { id: 4c918145-f5b2-4879-b176-6a46c3dfa233 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3498081), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 230cbb3f-fd82-41ff-b241-18559d2a8099, kind: Instance { id: 4c918145-f5b2-4879-b176-6a46c3dfa233 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3498081), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(3498081))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 230cbb3f-fd82-41ff-b241-18559d2a8099, kind: Instance { id: 4c918145-f5b2-4879-b176-6a46c3dfa233 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3498081), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 072f2795-bb12-487f-989f-6a4b04090567, slot: 0, read_only: false, vcr_json: .., name: "disk-c7d670cacc8" }], boot_settings: Some(InstanceBootSettings { order: [072f2795-bb12-487f-989f-6a4b04090567] }), cloud_init_bytes: Some(..) } instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 metadata = InstanceMetadata { silo_id: 0cccb791-faa1-4a28-8d2b-175c6fc167b3, project_id: b2eeea48-125f-4835-812c-c33c17d5f1fa } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T05:55:01.312758638Z }
29052024-12-21T05:55:01.317ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 migration_id = None propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29062024-12-21T05:55:01.318ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 migration_id = None propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 230cbb3f-fd82-41ff-b241-18559d2a8099, kind: Instance { id: 4c918145-f5b2-4879-b176-6a46c3dfa233 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3498081), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 230cbb3f-fd82-41ff-b241-18559d2a8099, kind: Instance { id: 4c918145-f5b2-4879-b176-6a46c3dfa233 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3498081), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 230cbb3f-fd82-41ff-b241-18559d2a8099, kind: Instance { id: 4c918145-f5b2-4879-b176-6a46c3dfa233 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3498081), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(3498081))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 230cbb3f-fd82-41ff-b241-18559d2a8099, kind: Instance { id: 4c918145-f5b2-4879-b176-6a46c3dfa233 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(3498081), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 072f2795-bb12-487f-989f-6a4b04090567, slot: 0, read_only: false, vcr_json: .., name: "disk-c7d670cacc8" }], boot_settings: Some(InstanceBootSettings { order: [072f2795-bb12-487f-989f-6a4b04090567] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T05:55:01.312758638Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29072024-12-21T05:55:01.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6578 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63010 req_id = f8a7b9d8-5622-423f-8b76-05627c7a216a response_code = 200 uri = /vmms/1074852b-efc2-4d12-a5fc-d885405cbf4e
29082024-12-21T05:55:01.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49204
29092024-12-21T05:55:01.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49204 req_id = f8f01154-f19f-4a2a-9806-7ead7274f4db response_code = 200 uri = /vmms/1074852b-efc2-4d12-a5fc-d885405cbf4e/state
29102024-12-21T05:55:01.407ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 3498081 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29112024-12-21T05:55:01.407ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29122024-12-21T05:55:01.458ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e file = illumos-utils/src/zone.rs:325 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29132024-12-21T05:55:01.489ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e file = illumos-utils/src/zone.rs:363 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29142024-12-21T05:55:01.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35567
29152024-12-21T05:55:01.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35567 req_id = cb49faa9-274b-4ab6-91d4-c7d90bcc170e response_code = 200 uri = /vpc-routes
29162024-12-21T05:55:01.599ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {230cbb3f-fd82-41ff-b241-18559d2a8099: {10.151.2.175: {27af947d-3919-4aa9-a4d4-478b14599c0a}, 10.151.2.176: {27af947d-3919-4aa9-a4d4-478b14599c0a}}} }
29172024-12-21T05:55:03.113ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29182024-12-21T05:55:03.113ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e zone file = illumos-utils/src/running_zone.rs:488 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e zone = oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e
29192024-12-21T05:55:03.289ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e") failed: Property not found. retry in 62.587478ms file = illumos-utils/src/svc.rs:36 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e zone = oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e
29202024-12-21T05:55:03.377ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e") failed: Property not found. retry in 101.706302ms file = illumos-utils/src/svc.rs:36 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e zone = oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e
29212024-12-21T05:55:03.495ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e") failed: Property not found. retry in 175.867942ms file = illumos-utils/src/svc.rs:36 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e zone = oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e
29222024-12-21T05:55:03.691ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e") failed: Property not found. retry in 296.004732ms file = illumos-utils/src/svc.rs:36 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e zone = oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e
29232024-12-21T05:55:04.002ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e") failed: Property not found. retry in 1.009149648s file = illumos-utils/src/svc.rs:36 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e zone = oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e
29242024-12-21T05:55:05.025ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e") failed: Property not found. retry in 778.472916ms file = illumos-utils/src/svc.rs:36 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e zone = oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e
29252024-12-21T05:55:05.815ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e") failed: Property not found. retry in 1.316347989s file = illumos-utils/src/svc.rs:36 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e zone = oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e
29262024-12-21T05:55:07.143ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e") failed: Property not found. retry in 1.271504052s file = illumos-utils/src/svc.rs:36 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e zone = oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e
29272024-12-21T05:55:08.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51770
29282024-12-21T05:55:08.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35801
29292024-12-21T05:55:08.172ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29302024-12-21T05:55:08.215ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29312024-12-21T05:55:08.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106304 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35801 req_id = b9aae0e0-ec98-467d-9a31-5dc75df0de92 response_code = 204 uri = /switch-ports
29322024-12-21T05:55:08.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56027
29332024-12-21T05:55:08.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56027 req_id = d86a7d7f-4735-40e0-91b2-c1f98fe54d7a response_code = 200 uri = /v2p
29342024-12-21T05:55:08.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35801 req_id = 88145f2b-866e-440a-9aa5-9427fa6bd7fa response_code = 200 uri = /network-bootstore-config
29352024-12-21T05:55:08.451ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e file = sled-agent/src/instance.rs:2067 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29362024-12-21T05:55:08.463ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e") failed: Property not found. retry in 47.268827ms file = illumos-utils/src/svc.rs:36 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29372024-12-21T05:55:08.522ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e") failed: Property not found. retry in 79.249747ms file = illumos-utils/src/svc.rs:36 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29382024-12-21T05:55:08.613ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e") failed: Property not found. retry in 228.138939ms file = illumos-utils/src/svc.rs:36 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29392024-12-21T05:55:08.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62516
29402024-12-21T05:55:08.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51033
29412024-12-21T05:55:08.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51033 req_id = acfd56b9-eb8b-43e3-80fe-26d20134d254 response_code = 200 uri = /vpc-routes
29422024-12-21T05:55:08.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48358
29432024-12-21T05:55:08.810ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29442024-12-21T05:55:08.851ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29452024-12-21T05:55:08.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48358 req_id = 484a170e-e956-4743-98cc-052637924de4 response_code = 204 uri = /switch-ports
29462024-12-21T05:55:08.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54174
29472024-12-21T05:55:08.912ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {230cbb3f-fd82-41ff-b241-18559d2a8099: {10.151.2.176: {27af947d-3919-4aa9-a4d4-478b14599c0a}, 10.151.2.175: {27af947d-3919-4aa9-a4d4-478b14599c0a}}} }
29482024-12-21T05:55:08.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 953 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48358 req_id = 56849ba8-5837-4969-b49f-120299ace1b2 response_code = 200 uri = /network-bootstore-config
29492024-12-21T05:55:08.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3813 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51033 req_id = 9450e434-a16f-40e4-a53f-cf3891c7a3fc response_code = 204 uri = /eip-gateways
29502024-12-21T05:55:08.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54174 req_id = 6f19bc47-ffec-4262-8790-1d826f3621c4 response_code = 200 uri = /v2p
29512024-12-21T05:55:08.919ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29522024-12-21T05:55:08.956ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29532024-12-21T05:55:09.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51033 req_id = 2b3652ac-fafb-4f2a-8fc4-c94c82adb99e response_code = 204 uri = /vpc-routes
29542024-12-21T05:55:09.100ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29552024-12-21T05:55:09.100ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
29562024-12-21T05:55:09.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 440808 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62516 req_id = 9917a405-e928-48a7-a4eb-8ab4e46918bc response_code = 200 uri = /vmms/1074852b-efc2-4d12-a5fc-d885405cbf4e/state
29572024-12-21T05:55:09.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1091848 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51770 req_id = 35a0ad6a-4bf5-4578-bd95-8bf76b63b03d response_code = 200 uri = /vmms/1074852b-efc2-4d12-a5fc-d885405cbf4e/state
29582024-12-21T05:55:09.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7502242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35567 req_id = 889c0fdc-fa20-4ab8-aaba-94f298c8e165 response_code = 204 uri = /eip-gateways
29592024-12-21T05:55:09.103ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-21T05:55:09.102821703Z } file = sled-agent/src/instance.rs:780 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29602024-12-21T05:55:09.103ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T05:55:09.102821703Z } propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29612024-12-21T05:55:09.103ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T05:55:09.102821703Z }, migration_in: None, migration_out: None }
29622024-12-21T05:55:09.123ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-21T05:55:09.123194914Z } file = sled-agent/src/instance.rs:780 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29632024-12-21T05:55:09.123ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T05:55:09.123194914Z } propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29642024-12-21T05:55:09.123ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T05:55:09.123194914Z }, migration_in: None, migration_out: None }
29652024-12-21T05:55:09.205ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 3c440ac3-dd89-4efa-9124-e97178c54bb8, version: 3 } old_vers = RouterVersion { router_id: 3c440ac3-dd89-4efa-9124-e97178c54bb8, version: 3 } subnet = RouterId { vni: Vni(3498081), kind: System }
29662024-12-21T05:55:09.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35567 req_id = 398660df-d006-4615-a93e-66be754a9b3b response_code = 204 uri = /vpc-routes
29672024-12-21T05:55:09.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43924
29682024-12-21T05:55:09.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43924 req_id = cdbf45ea-1b0c-428e-887b-0322ef4ce4fc response_code = 200 uri = /vpc-routes
29692024-12-21T05:55:09.324ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {230cbb3f-fd82-41ff-b241-18559d2a8099: {10.151.2.176: {27af947d-3919-4aa9-a4d4-478b14599c0a}, 10.151.2.175: {27af947d-3919-4aa9-a4d4-478b14599c0a}}} }
29702024-12-21T05:55:09.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43924 req_id = 40d98860-80f9-4eb0-8c7f-65195c667d9b response_code = 204 uri = /eip-gateways
29712024-12-21T05:55:09.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43924 req_id = 8f9a09ac-739a-4f3a-95c4-54242fe8d67a response_code = 204 uri = /vpc-routes
29722024-12-21T05:55:12.567ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63031
29732024-12-21T05:55:12.567ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63031 req_id = af399e98-f459-443b-af52-f9ce9385cffb response_code = 200 uri = /baseboard
29742024-12-21T05:55:13.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61104
29752024-12-21T05:55:13.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61104 req_id = 26f5f6da-9171-4227-b6ac-c4cdbad79531 response_code = 200 uri = /vmms/1074852b-efc2-4d12-a5fc-d885405cbf4e/state
29762024-12-21T05:55:13.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57015
29772024-12-21T05:55:13.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57015 req_id = 74bc35b9-ce53-45df-a82d-ea293563471a response_code = 200 uri = /v2p
29782024-12-21T05:55:13.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38335
29792024-12-21T05:55:13.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38335 req_id = 634ea559-585d-4fd4-91c2-c762d3237666 response_code = 200 uri = /vpc-routes
29802024-12-21T05:55:13.367ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {230cbb3f-fd82-41ff-b241-18559d2a8099: {10.151.2.176: {27af947d-3919-4aa9-a4d4-478b14599c0a}, 10.151.2.175: {27af947d-3919-4aa9-a4d4-478b14599c0a}}} }
29812024-12-21T05:55:13.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38335 req_id = dd9127ba-da9e-4d68-a5cd-28e6dd84ad9a response_code = 204 uri = /eip-gateways
29822024-12-21T05:55:13.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38335 req_id = c559c6d8-acbb-4a49-8bf9-1c5d2be7c108 response_code = 204 uri = /vpc-routes
29832024-12-21T05:55:13.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38618
29842024-12-21T05:55:13.457ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29852024-12-21T05:55:13.496ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29862024-12-21T05:55:13.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96883 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38618 req_id = a5c22357-ef79-475d-acaa-d439c0f351a3 response_code = 204 uri = /switch-ports
29872024-12-21T05:55:13.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38618 req_id = 67b2ca3d-f24d-4d03-a6f3-5d2a7db2a657 response_code = 200 uri = /network-bootstore-config
29882024-12-21T05:55:17.833ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8468 local_addr = [fd00:1122:3344:101::1]:35623 method = GET remote_addr = [fd00:1122:3344:101::d]:57258 req_id = 1adadf21-265b-4034-b46b-56d6428b9a31 response_code = 200 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 uri = /67885466-b1c6-48f5-a800-f848c80749b6
29892024-12-21T05:55:19.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64440
29902024-12-21T05:55:19.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1046 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64440 req_id = 4f13bfbe-d644-4b4e-93a3-d1566b8aca00 response_code = 200 uri = /vmms/1074852b-efc2-4d12-a5fc-d885405cbf4e/state
29912024-12-21T05:55:19.107ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-21T05:55:19.107948238Z } file = sled-agent/src/instance.rs:780 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29922024-12-21T05:55:19.107ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T05:55:19.107948238Z } propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29932024-12-21T05:55:19.108ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T05:55:19.107948238Z }, migration_in: None, migration_out: None }
29942024-12-21T05:55:19.147ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-21T05:55:19.147109140Z } file = sled-agent/src/instance.rs:780 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29952024-12-21T05:55:19.147ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-21T05:55:19.147109140Z } propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29962024-12-21T05:55:19.147ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
29972024-12-21T05:55:19.147ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29982024-12-21T05:55:19.147ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 707042786266404715 n_samples = 6 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
29992024-12-21T05:55:19.147ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 7268496847793963051 n_samples = 6 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
30002024-12-21T05:55:19.147ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30012024-12-21T05:55:19.148ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/8e1195b9-2419-4586-9028-afdd4f181dd0/debug/bundle/zone", "/pool/int/c2c552a1-f416-4f8c-90e9-2c18efd74095/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/7912c084-27e1-426d-a3ef-7d0f642d9382/crypt/debug", "/pool/ext/3351d590-858e-45b6-91ff-51f0d9e17995/crypt/debug", "/pool/ext/871c983c-3586-410a-849e-2f5b0cbe8e62/crypt/debug", "/pool/ext/2bb3541f-3c91-4f12-b4ac-85be5075aa6a/crypt/debug", "/pool/ext/144378a5-cfc6-44e1-8dd6-f07860f0a722/crypt/debug", "/pool/ext/daf1d0a1-d6b9-49f1-9e21-7ba5091043cb/crypt/debug", "/pool/ext/eddbd6ad-6d1a-4b15-b651-c9b7507577a9/crypt/debug", "/pool/ext/3eb8e40a-92f6-40bc-8e6f-5601d59b5ab0/crypt/debug", "/pool/ext/fa625e73-0c39-487d-9929-b234b9ea83f9/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e
30022024-12-21T05:55:19.788ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e", bundle_id: 1c5c0283-b8ef-42b0-b6f5-98f8b04329b4 }, time_created: 2024-12-21T05:55:19.148925674Z, version: 0, cause: TerminatedInstance }
30032024-12-21T05:55:19.788ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_1074852b-efc2-4d12-a5fc-d885405cbf4e file = sled-agent/src/instance.rs:1313 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
30042024-12-21T05:55:21.525ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
30052024-12-21T05:55:21.541ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(3498081), kind: System }
30062024-12-21T05:55:21.541ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(3498081), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30072024-12-21T05:55:21.542ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T05:55:21.542205922Z }, migration_in: None, migration_out: None }
30082024-12-21T05:55:21.565ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T05:55:21.542205922Z }, migration_in: None, migration_out: None }
30092024-12-21T05:55:21.570ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = 4c918145-f5b2-4879-b176-6a46c3dfa233 propolis_id = 1074852b-efc2-4d12-a5fc-d885405cbf4e
30102024-12-21T05:55:21.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58701
30112024-12-21T05:55:21.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58701 req_id = 70223a5f-11e7-433d-8b35-e562002b4de2 response_code = 200 uri = /vpc-routes
30122024-12-21T05:55:21.964ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {230cbb3f-fd82-41ff-b241-18559d2a8099: {10.151.2.176: {27af947d-3919-4aa9-a4d4-478b14599c0a}, 10.151.2.175: {27af947d-3919-4aa9-a4d4-478b14599c0a}}} }
30132024-12-21T05:55:21.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58701 req_id = 430a7e54-1e42-41fb-b90b-8624c5a8300d response_code = 204 uri = /eip-gateways
30142024-12-21T05:55:21.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58701 req_id = 01fa5fc5-a636-443b-9aeb-b0054cdc24e4 response_code = 204 uri = /vpc-routes
30152024-12-21T05:55:22.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35461
30162024-12-21T05:55:22.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35461 req_id = e8b94a55-09f2-47d9-b4c4-ace5bcea810b response_code = 200 uri = /v2p
30172024-12-21T05:55:22.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33069
30182024-12-21T05:55:22.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33069 req_id = b30a5c2c-672a-4324-b821-e777f2ae4615 response_code = 200 uri = /v2p
30192024-12-21T05:55:22.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57184
30202024-12-21T05:55:22.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57184 req_id = 243b2e0b-285c-4b93-9277-a841152f0899 response_code = 200 uri = /vpc-routes
30212024-12-21T05:55:22.716ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
30222024-12-21T05:55:22.716ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6
30232024-12-21T05:55:22.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57184 req_id = 41f4dfd0-be16-48ad-8f23-395d39865cb0 response_code = 204 uri = /eip-gateways
30242024-12-21T05:55:22.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57184 req_id = 47913e12-b67a-45fd-a8ac-23654568661a response_code = 204 uri = /vpc-routes
30252024-12-21T05:55:23.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56909
30262024-12-21T05:55:23.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56909 req_id = ca49a134-c1da-4c56-b786-a2c3d841c8b3 response_code = 200 uri = /vpc-routes
30272024-12-21T05:55:23.331ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 67885466-b1c6-48f5-a800-f848c80749b6 values = ExternalIpGatewayMap { mappings: {} }
30282024-12-21T05:55:23.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56909 req_id = 298a5484-1e62-4d7a-a966-26f9915cb0e1 response_code = 204 uri = /eip-gateways
30292024-12-21T05:55:23.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56909 req_id = d114d2af-830e-4b7b-bd23-c751295ddd34 response_code = 204 uri = /vpc-routes