Max level shown:
1 [ Dec 21 00:43:35 Enabled. ]
2 [ Dec 21 00:43:35 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 21 00:43:35 Method "start" exited with status 0. ]
4 [ Dec 21 00:43:35 Rereading configuration. ]
5 [ Dec 21 00:43:35 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-21T00:43:35.268ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-21T00:43:35.268ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-21T00:43:35.321ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-21T00:43:35.321ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-21T00:43:35.435ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-21T00:43:35.444ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-21T00:43:35.452ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-21T00:43:36.055ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-21T00:43:36.193ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-21T00:43:36.193ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-21T00:43:36.193ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-21T00:43:36.193ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-21T00:43:36.193ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-12-21T00:43:36.193ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-12-21T00:43:36.196ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-21T00:43:36.196ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-21T00:43:36.196ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-21T00:43:36.196ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-21T00:43:36.196ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-21T00:43:36.196ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-21T00:43:36.196ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-21T00:43:36.196ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-21T00:43:36.196ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-21T00:43:36.208ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-21T00:43:36.208ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool)
322024-12-21T00:43:36.308ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal }
332024-12-21T00:43:36.673ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-21T00:43:36.673ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-21T00:43:36.673ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-21T00:43:36.673ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-21T00:43:36.673ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382024-12-21T00:43:36.673ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-21T00:43:36.673ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-21T00:43:36.682ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-21T00:43:36.682ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool)
422024-12-21T00:43:36.769ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal }
432024-12-21T00:43:37.127ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-21T00:43:37.127ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-21T00:43:37.127ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-21T00:43:37.127ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-21T00:43:37.127ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482024-12-21T00:43:37.127ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-21T00:43:37.127ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-21T00:43:37.127ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-21T00:43:37.127ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-21T00:43:37.127ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
532024-12-21T00:43:37.127ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-12-21T00:43:37.127ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-21T00:43:37.127ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-21T00:43:37.127ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-21T00:43:37.127ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
582024-12-21T00:43:37.127ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-12-21T00:43:37.127ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-12-21T00:43:37.127ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-12-21T00:43:37.127ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-21T00:43:37.127ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632024-12-21T00:43:37.127ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-12-21T00:43:37.127ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652024-12-21T00:43:37.127ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-21T00:43:37.127ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-21T00:43:37.127ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-21T00:43:37.127ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-21T00:43:37.127ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
702024-12-21T00:43:37.127ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
712024-12-21T00:43:37.127ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722024-12-21T00:43:37.127ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-12-21T00:43:37.127ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-21T00:43:37.127ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-21T00:43:37.128ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-21T00:43:37.128ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-21T00:43:37.128ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782024-12-21T00:43:37.128ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-21T00:43:37.128ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-21T00:43:37.128ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-12-21T00:43:37.128ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
822024-12-21T00:43:37.128ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
832024-12-21T00:43:37.128ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
842024-12-21T00:43:37.128ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-12-21T00:43:37.128ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-21T00:43:37.128ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-12-21T00:43:37.128ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882024-12-21T00:43:37.128ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
892024-12-21T00:43:37.128ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
902024-12-21T00:43:37.128ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-12-21T00:43:37.128ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-21T00:43:37.128ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932024-12-21T00:43:37.128ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942024-12-21T00:43:37.128ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952024-12-21T00:43:37.128ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-21T00:43:37.128ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-21T00:43:37.128ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-21T00:43:37.128ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-21T00:43:37.128ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-12-21T00:43:37.128ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-12-21T00:43:37.128ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-12-21T00:43:37.128ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032024-12-21T00:43:37.128ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-21T00:43:37.128ZINFOSledAgent (bootstore): No ledger in /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-21T00:43:37.128ZINFOSledAgent (bootstore): No ledger in /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-21T00:43:37.128ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-12-21T00:43:37.128ZINFOSledAgent (bootstore): No ledger in /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-21T00:43:37.128ZINFOSledAgent (bootstore): No ledger in /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-21T00:43:37.128ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-12-21T00:43:37.128ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-21T00:43:37.128ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-21T00:43:37.139ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132024-12-21T00:43:37.139ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1349, tv_nsec: 280316306 } time_to_next_cleanup = 599.999918308s
1142024-12-21T00:43:37.139ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1152024-12-21T00:43:37.139ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1162024-12-21T00:43:37.139ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-21T00:43:37.139ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-21T00:43:37.142ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-12-21T00:43:37.144ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-12-21T00:43:37.144ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-21T00:43:37.144ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-21T00:43:37.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232024-12-21T00:43:37.144ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242024-12-21T00:43:37.144ZINFOSledAgent (RSS): No ledger in /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-21T00:43:37.144ZINFOSledAgent (RSS): No ledger in /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-21T00:43:37.144ZINFOSledAgent (RSS): No ledger in /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-21T00:43:37.144ZINFOSledAgent (RSS): No ledger in /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-21T00:43:37.144ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-21T00:43:37.145ZINFOSledAgent (RSS): Writing ledger to /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-21T00:43:37.145ZINFOSledAgent (RSS): Writing ledger to /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-21T00:43:37.145ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-21T00:43:37.145ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-21T00:43:37.145ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-21T00:43:37.145ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-21T00:43:37.145ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362024-12-21T00:43:37.145ZINFOSledAgent (bootstore): Writing ledger to /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-12-21T00:43:37.145ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382024-12-21T00:43:37.145ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392024-12-21T00:43:37.145ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: bf099da7-dcc9-4db5-96e6-2fb4244a4a3c (sled), rack_id: b4a43785-b93e-4203-8bbb-be9c4e6bfa2c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402024-12-21T00:43:37.146ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1412024-12-21T00:43:37.146ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1422024-12-21T00:43:37.150ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-21T00:43:37.156ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-21T00:43:37.156ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-21T00:43:37.161ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-21T00:43:37.161ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-21T00:43:37.161ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:48532
1482024-12-21T00:43:37.161ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: bf099da7-dcc9-4db5-96e6-2fb4244a4a3c (sled), rack_id: b4a43785-b93e-4203-8bbb-be9c4e6bfa2c, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-21T00:43:37.161ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-21T00:43:37.161ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-21T00:43:37.161ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-21T00:43:37.161ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532024-12-21T00:43:37.161ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542024-12-21T00:43:37.161ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552024-12-21T00:43:37.161ZINFOSledAgent (StorageManager): No ledger in /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-12-21T00:43:37.161ZINFOSledAgent (StorageManager): No ledger in /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-21T00:43:37.161ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582024-12-21T00:43:37.161ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592024-12-21T00:43:37.161ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602024-12-21T00:43:37.161ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-21T00:43:37.161ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622024-12-21T00:43:37.178ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632024-12-21T00:43:37.198ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-21T00:43:37.215ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-21T00:43:37.243ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
1662024-12-21T00:43:37.243ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672024-12-21T00:43:37.243ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1682024-12-21T00:43:37.243ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
1692024-12-21T00:43:37.246ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 61.580642ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "737bc140-adc7-4fbe-be5f-ab914076d3b5", "content-length": "124", "date": "Sat, 21 Dec 2024 00:43:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "737bc140-adc7-4fbe-be5f-ab914076d3b5" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-21T00:43:37.255ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_be00bd5f-3434-4c14-9c45-f233f78ceaf1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-21T00:43:37.280ZINFOSledAgent: successfully created encrypted zvol: name="oxi_be00bd5f-3434-4c14-9c45-f233f78ceaf1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-21T00:43:37.280ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_be00bd5f-3434-4c14-9c45-f233f78ceaf1/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-21T00:43:37.285ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
1742024-12-21T00:43:37.285ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752024-12-21T00:43:37.285ZINFOSledAgent (BackingFs): Ensuring dataset oxi_be00bd5f-3434-4c14-9c45-f233f78ceaf1/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762024-12-21T00:43:37.308ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-21T00:43:37.309ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 150.782063ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9548ee81-ffb6-4195-887a-dbf465bee625", "content-length": "124", "date": "Sat, 21 Dec 2024 00:43:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9548ee81-ffb6-4195-887a-dbf465bee625" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-21T00:43:37.353ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792024-12-21T00:43:37.461ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-21T00:43:37.462ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 114.273316ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2e73fe89-658d-498d-9152-ee7f7a855d4f", "content-length": "124", "date": "Sat, 21 Dec 2024 00:43:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2e73fe89-658d-498d-9152-ee7f7a855d4f" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-21T00:43:37.572ZINFOSledAgent (BackingFs): Mounting oxi_be00bd5f-3434-4c14-9c45-f233f78ceaf1/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822024-12-21T00:43:37.577ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-12-21T00:43:37.577ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 236.666617ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "766e0214-439f-46af-8e2c-f9afff443ea3", "content-length": "124", "date": "Sat, 21 Dec 2024 00:43:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "766e0214-439f-46af-8e2c-f9afff443ea3" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-12-21T00:43:37.585ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852024-12-21T00:43:37.585ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862024-12-21T00:43:37.585ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872024-12-21T00:43:37.585ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882024-12-21T00:43:37.815ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-21T00:43:37.816ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 139.418821ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "af2d2dec-3059-412f-b8fb-c6927a8b8bb3", "content-length": "124", "date": "Sat, 21 Dec 2024 00:43:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "af2d2dec-3059-412f-b8fb-c6927a8b8bb3" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-21T00:43:37.958ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-21T00:43:37.958ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 314.169665ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8982723d-dcc8-44e8-8b5e-46d4b7e0e292", "content-length": "124", "date": "Sat, 21 Dec 2024 00:43:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8982723d-dcc8-44e8-8b5e-46d4b7e0e292" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-21T00:43:38.274ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-21T00:43:38.319ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
1942024-12-21T00:43:38.325ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:63341 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
1952024-12-21T00:43:38.325ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
1962024-12-21T00:43:38.325ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:63341 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
1972024-12-21T00:43:38.326ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 144.607159ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
1982024-12-21T00:43:38.327ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
1992024-12-21T00:43:38.327ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2002024-12-21T00:43:38.327ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2012024-12-21T00:43:38.327ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2022024-12-21T00:43:38.472ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 553.816449ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2032024-12-21T00:43:39.026ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 773.057228ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2042024-12-21T00:43:39.801ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.917112464s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2052024-12-21T00:43:40.919ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2062024-12-21T00:43:40.919ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2072024-12-21T00:43:40.919ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2082024-12-21T00:43:40.919ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2092024-12-21T00:43:40.919ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2102024-12-21T00:43:40.919ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2112024-12-21T00:43:40.921ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2122024-12-21T00:43:40.922ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2132024-12-21T00:43:40.923ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='14ec024d-4716-45d3-968b-3353bbdfdd75'/> <propval type="astring" name="rack_id" value='b4a43785-b93e-4203-8bbb-be9c4e6bfa2c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe26:1d19'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='b4a43785-b93e-4203-8bbb-be9c4e6bfa2c'/> <propval type="astring" name="sled_id" value='bf099da7-dcc9-4db5-96e6-2fb4244a4a3c'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='bf099da7-dcc9-4db5-96e6-2fb4244a4a3c'/> <propval type="astring" name="rack_uuid" value='b4a43785-b93e-4203-8bbb-be9c4e6bfa2c'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='bf099da7-dcc9-4db5-96e6-2fb4244a4a3c'/> <propval type="astring" name="rack_uuid" value='b4a43785-b93e-4203-8bbb-be9c4e6bfa2c'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142024-12-21T00:43:40.923ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152024-12-21T00:43:41.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 35.914532ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-21T00:43:41.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 114.686973ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-12-21T00:43:41.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 179.324003ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-21T00:43:41.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 479.559335ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-21T00:43:42.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 423.83248ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-21T00:43:42.720ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.876023053s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2212024-12-21T00:43:42.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 619.810662ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-21T00:43:43.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.143775335s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-21T00:43:44.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 756.545161ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-21T00:43:45.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.17929126s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-21T00:43:47.489ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/nexus.rs:527 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2262024-12-21T00:43:47.519ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2272024-12-21T00:43:47.519ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2282024-12-21T00:43:47.521ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2292024-12-21T00:43:47.521ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2302024-12-21T00:43:47.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2312024-12-21T00:43:47.521ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322024-12-21T00:43:47.521ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332024-12-21T00:43:47.521ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342024-12-21T00:43:47.521ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352024-12-21T00:43:47.521ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2362024-12-21T00:43:47.521ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:48532
2372024-12-21T00:43:47.725ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2382024-12-21T00:43:47.725ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2392024-12-21T00:43:47.726ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.08213133s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2402024-12-21T00:43:47.729ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2412024-12-21T00:43:47.729ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2422024-12-21T00:43:47.729ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2432024-12-21T00:43:47.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36124
2442024-12-21T00:43:47.967ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452024-12-21T00:43:47.967ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462024-12-21T00:43:47.967ZINFOSledAgent (ServiceManager): No ledger in /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:188
2472024-12-21T00:43:47.967ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:188
2482024-12-21T00:43:47.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36124 req_id = 4f46ad87-de6b-4096-a4d4-ce76426f1dcc response_code = 200 uri = /inventory
2492024-12-21T00:43:47.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42375
2502024-12-21T00:43:47.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42375 req_id = 616e87dd-536a-4f3d-aded-1a2bc3176f61 response_code = 200 uri = /sled-role
2512024-12-21T00:43:48.031ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b0d748e9-640e-4894-a0ad-de0823f79e07 (physical_disk), pool_id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3976e6fb-7ac2-444b-b31c-d7fdf1d1cc29 (physical_disk), pool_id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 6c7f44b8-b919-46f9-b39a-2d0fd86ca5d4 (physical_disk), pool_id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: aa6e37c8-3e75-4d26-88a0-8a97513e7201 (physical_disk), pool_id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f68f04d6-e1bd-43c2-9a16-0831cc546c09 (physical_disk), pool_id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 8bedd99d-e291-4947-8945-ab75adccf19f (physical_disk), pool_id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e49ce6c7-b9ef-4c27-964c-f2fcbcc20a92 (physical_disk), pool_id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 78e3a21f-4a6c-43b3-aed9-6261f6a1150d (physical_disk), pool_id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 238e6014-5ada-4040-a5f5-fce3e9da0fb3 (physical_disk), pool_id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2522024-12-21T00:43:48.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35770
2532024-12-21T00:43:48.032ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2542024-12-21T00:43:48.032ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b0d748e9-640e-4894-a0ad-de0823f79e07 (physical_disk), pool_id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3976e6fb-7ac2-444b-b31c-d7fdf1d1cc29 (physical_disk), pool_id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 6c7f44b8-b919-46f9-b39a-2d0fd86ca5d4 (physical_disk), pool_id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: aa6e37c8-3e75-4d26-88a0-8a97513e7201 (physical_disk), pool_id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f68f04d6-e1bd-43c2-9a16-0831cc546c09 (physical_disk), pool_id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 8bedd99d-e291-4947-8945-ab75adccf19f (physical_disk), pool_id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e49ce6c7-b9ef-4c27-964c-f2fcbcc20a92 (physical_disk), pool_id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 78e3a21f-4a6c-43b3-aed9-6261f6a1150d (physical_disk), pool_id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 238e6014-5ada-4040-a5f5-fce3e9da0fb3 (physical_disk), pool_id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2552024-12-21T00:43:48.032ZINFOSledAgent (StorageManager): No ledger in /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562024-12-21T00:43:48.032ZINFOSledAgent (StorageManager): No ledger in /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572024-12-21T00:43:48.032ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2582024-12-21T00:43:48.032ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2592024-12-21T00:43:48.032ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2602024-12-21T00:43:48.032ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2612024-12-21T00:43:48.032ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2622024-12-21T00:43:48.169ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2632024-12-21T00:43:48.169ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool)
2642024-12-21T00:43:48.375ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2652024-12-21T00:43:48.375ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2662024-12-21T00:43:48.578ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2672024-12-21T00:43:48.580ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
2682024-12-21T00:43:48.641ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }
2692024-12-21T00:43:48.649ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2702024-12-21T00:43:48.649ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2712024-12-21T00:43:48.649ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2722024-12-21T00:43:48.649ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2732024-12-21T00:43:48.649ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742024-12-21T00:43:48.649ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-12-21T00:43:48.649ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2762024-12-21T00:43:48.685ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2772024-12-21T00:43:48.694ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone file = sled-storage/src/dataset.rs:302
2782024-12-21T00:43:48.840ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_590ffd4f-3c08-4aaa-9320-324eceef269f file = sled-storage/src/dataset.rs:388
2792024-12-21T00:43:48.848ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802024-12-21T00:43:48.848ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812024-12-21T00:43:48.848ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822024-12-21T00:43:48.848ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832024-12-21T00:43:48.848ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842024-12-21T00:43:48.857ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852024-12-21T00:43:48.857ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c679f342-f128-44a0-ab2d-f59379b9850c (zpool)
2862024-12-21T00:43:48.952ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }
2872024-12-21T00:43:48.959ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2882024-12-21T00:43:48.959ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2892024-12-21T00:43:48.959ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2902024-12-21T00:43:48.959ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2912024-12-21T00:43:48.959ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-21T00:43:48.960ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-12-21T00:43:48.960ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2942024-12-21T00:43:48.993ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952024-12-21T00:43:49.001ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crypt/zone file = sled-storage/src/dataset.rs:302
2962024-12-21T00:43:49.138ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c679f342-f128-44a0-ab2d-f59379b9850c file = sled-storage/src/dataset.rs:388
2972024-12-21T00:43:49.147ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982024-12-21T00:43:49.147ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992024-12-21T00:43:49.147ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002024-12-21T00:43:49.147ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012024-12-21T00:43:49.147ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022024-12-21T00:43:49.156ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032024-12-21T00:43:49.156ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool)
3042024-12-21T00:43:49.248ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }
3052024-12-21T00:43:49.256ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3062024-12-21T00:43:49.256ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3072024-12-21T00:43:49.256ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3082024-12-21T00:43:49.256ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3092024-12-21T00:43:49.256ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-21T00:43:49.256ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-12-21T00:43:49.256ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3122024-12-21T00:43:49.290ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132024-12-21T00:43:49.298ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/zone file = sled-storage/src/dataset.rs:302
3142024-12-21T00:43:49.437ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_73f3806f-f01a-4ed9-9018-33c83b997a06 file = sled-storage/src/dataset.rs:388
3152024-12-21T00:43:49.445ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162024-12-21T00:43:49.445ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172024-12-21T00:43:49.445ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182024-12-21T00:43:49.445ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192024-12-21T00:43:49.445ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202024-12-21T00:43:49.455ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212024-12-21T00:43:49.455ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d31b745a-6af3-41e8-a39a-73607778df7f (zpool)
3222024-12-21T00:43:49.548ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }
3232024-12-21T00:43:49.556ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3242024-12-21T00:43:49.556ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3252024-12-21T00:43:49.556ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3262024-12-21T00:43:49.556ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3272024-12-21T00:43:49.556ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-12-21T00:43:49.556ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-12-21T00:43:49.556ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3302024-12-21T00:43:49.582ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
3312024-12-21T00:43:49.592ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322024-12-21T00:43:49.600ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d31b745a-6af3-41e8-a39a-73607778df7f/crypt/zone file = sled-storage/src/dataset.rs:302
3332024-12-21T00:43:49.738ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d31b745a-6af3-41e8-a39a-73607778df7f file = sled-storage/src/dataset.rs:388
3342024-12-21T00:43:49.747ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3352024-12-21T00:43:49.747ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3362024-12-21T00:43:49.747ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3372024-12-21T00:43:49.747ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382024-12-21T00:43:49.747ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392024-12-21T00:43:49.757ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3402024-12-21T00:43:49.757ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool)
3412024-12-21T00:43:49.850ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }
3422024-12-21T00:43:49.858ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3432024-12-21T00:43:49.858ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3442024-12-21T00:43:49.858ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3452024-12-21T00:43:49.858ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3462024-12-21T00:43:49.858ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-21T00:43:49.858ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-12-21T00:43:49.858ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3492024-12-21T00:43:49.894ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502024-12-21T00:43:49.901ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/zone file = sled-storage/src/dataset.rs:302
3512024-12-21T00:43:50.037ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a file = sled-storage/src/dataset.rs:388
3522024-12-21T00:43:50.046ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532024-12-21T00:43:50.046ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542024-12-21T00:43:50.046ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552024-12-21T00:43:50.046ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562024-12-21T00:43:50.046ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572024-12-21T00:43:50.055ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582024-12-21T00:43:50.055ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool)
3592024-12-21T00:43:50.153ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }
3602024-12-21T00:43:50.161ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3612024-12-21T00:43:50.161ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3622024-12-21T00:43:50.161ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3632024-12-21T00:43:50.161ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3642024-12-21T00:43:50.161ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-21T00:43:50.161ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-12-21T00:43:50.161ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3672024-12-21T00:43:50.197ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682024-12-21T00:43:50.204ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a/crypt/zone file = sled-storage/src/dataset.rs:302
3692024-12-21T00:43:50.343ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a file = sled-storage/src/dataset.rs:388
3702024-12-21T00:43:50.351ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712024-12-21T00:43:50.351ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722024-12-21T00:43:50.351ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732024-12-21T00:43:50.351ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742024-12-21T00:43:50.351ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752024-12-21T00:43:50.361ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762024-12-21T00:43:50.361ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool)
3772024-12-21T00:43:50.463ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }
3782024-12-21T00:43:50.471ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3792024-12-21T00:43:50.471ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3802024-12-21T00:43:50.471ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3812024-12-21T00:43:50.471ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3822024-12-21T00:43:50.471ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-12-21T00:43:50.471ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-21T00:43:50.471ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3852024-12-21T00:43:50.507ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862024-12-21T00:43:50.515ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/zone file = sled-storage/src/dataset.rs:302
3872024-12-21T00:43:50.584ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
3882024-12-21T00:43:50.655ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99 file = sled-storage/src/dataset.rs:388
3892024-12-21T00:43:50.663ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902024-12-21T00:43:50.663ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912024-12-21T00:43:50.663ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922024-12-21T00:43:50.663ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932024-12-21T00:43:50.663ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942024-12-21T00:43:50.673ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952024-12-21T00:43:50.673ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool)
3962024-12-21T00:43:50.767ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }
3972024-12-21T00:43:50.777ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3982024-12-21T00:43:50.777ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3992024-12-21T00:43:50.777ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4002024-12-21T00:43:50.777ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4012024-12-21T00:43:50.777ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-21T00:43:50.778ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-12-21T00:43:50.778ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4042024-12-21T00:43:50.815ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052024-12-21T00:43:50.822ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crypt/zone file = sled-storage/src/dataset.rs:302
4062024-12-21T00:43:50.952ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb file = sled-storage/src/dataset.rs:388
4072024-12-21T00:43:50.959ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082024-12-21T00:43:50.959ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092024-12-21T00:43:50.959ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102024-12-21T00:43:50.959ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112024-12-21T00:43:50.959ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122024-12-21T00:43:50.969ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132024-12-21T00:43:50.969ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool)
4142024-12-21T00:43:51.063ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }
4152024-12-21T00:43:51.071ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4162024-12-21T00:43:51.071ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4172024-12-21T00:43:51.071ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4182024-12-21T00:43:51.071ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4192024-12-21T00:43:51.071ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-21T00:43:51.071ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-12-21T00:43:51.071ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4222024-12-21T00:43:51.107ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232024-12-21T00:43:51.114ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b/crypt/zone file = sled-storage/src/dataset.rs:302
4242024-12-21T00:43:51.261ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b file = sled-storage/src/dataset.rs:388
4252024-12-21T00:43:51.268ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262024-12-21T00:43:51.268ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272024-12-21T00:43:51.268ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282024-12-21T00:43:51.268ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: be00bd5f-3434-4c14-9c45-f233f78ceaf1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a497e4d0-db89-46cf-a340-ab52cdcea7e0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292024-12-21T00:43:51.269ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302024-12-21T00:43:51.269ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312024-12-21T00:43:51.269ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322024-12-21T00:43:51.269ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
4332024-12-21T00:43:51.269ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4342024-12-21T00:43:51.269ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
4352024-12-21T00:43:51.269ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
4362024-12-21T00:43:51.269ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
4372024-12-21T00:43:51.269ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
4382024-12-21T00:43:51.269ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
4392024-12-21T00:43:51.269ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402024-12-21T00:43:51.269ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
4412024-12-21T00:43:51.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3237777 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35770 req_id = 70c9d071-8046-446d-9ac6-ee4139536076 response_code = 200 uri = /omicron-physical-disks
4422024-12-21T00:43:51.303ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {027c63ce-473a-4f5e-bae9-4134238ed150 (dataset): DatasetConfig { id: 027c63ce-473a-4f5e-bae9-4134238ed150 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02d40cc9-e99f-4901-95ae-817723824a33 (dataset): DatasetConfig { id: 02d40cc9-e99f-4901-95ae-817723824a33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04319dde-fd2a-4f7c-9690-f6d496dfc31b (dataset): DatasetConfig { id: 04319dde-fd2a-4f7c-9690-f6d496dfc31b (dataset), name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b58521b-c5cf-42b8-99de-4508a6fee57e (dataset): DatasetConfig { id: 0b58521b-c5cf-42b8-99de-4508a6fee57e (dataset), name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b8ef02d-3441-4805-928c-273453965794 (dataset): DatasetConfig { id: 0b8ef02d-3441-4805-928c-273453965794 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ced513c-5fbb-411f-b47b-5e9f8326aa72 (dataset): DatasetConfig { id: 0ced513c-5fbb-411f-b47b-5e9f8326aa72 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e2f020d-a5dc-4093-8a0c-509ad1c55630 (dataset): DatasetConfig { id: 0e2f020d-a5dc-4093-8a0c-509ad1c55630 (dataset), name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 103d60ba-978b-42cd-85d7-9ad55745756f (dataset): DatasetConfig { id: 103d60ba-978b-42cd-85d7-9ad55745756f (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10fcf612-1959-4410-b315-b019cc57a9bd (dataset): DatasetConfig { id: 10fcf612-1959-4410-b315-b019cc57a9bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 178bb4de-8328-4b4c-a398-135ab9c73756 (dataset): DatasetConfig { id: 178bb4de-8328-4b4c-a398-135ab9c73756 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1905c0ad-92d1-4ea2-9b86-58f01f584ce9 (dataset): DatasetConfig { id: 1905c0ad-92d1-4ea2-9b86-58f01f584ce9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19f2765c-9417-473f-a8b8-43d0f2d49d17 (dataset): DatasetConfig { id: 19f2765c-9417-473f-a8b8-43d0f2d49d17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b835633-a204-4f6d-8131-acf19923932f (dataset): DatasetConfig { id: 1b835633-a204-4f6d-8131-acf19923932f (dataset), name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1f570834-bcc0-4f5d-ab7f-130d9f74bdee (dataset): DatasetConfig { id: 1f570834-bcc0-4f5d-ab7f-130d9f74bdee (dataset), name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2bf5e34a-c30d-4876-b08c-a9bb6506d899 (dataset): DatasetConfig { id: 2bf5e34a-c30d-4876-b08c-a9bb6506d899 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e319c0f-400c-4736-9bd6-92dbc4f5a822 (dataset): DatasetConfig { id: 2e319c0f-400c-4736-9bd6-92dbc4f5a822 (dataset), name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ea49141-caf7-41a9-ad10-33a104e4f043 (dataset): DatasetConfig { id: 2ea49141-caf7-41a9-ad10-33a104e4f043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f91e164-59c8-4eae-bb64-ba103d55b200 (dataset): DatasetConfig { id: 2f91e164-59c8-4eae-bb64-ba103d55b200 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3241ab01-9aaf-4778-b764-d6cc05816f62 (dataset): DatasetConfig { id: 3241ab01-9aaf-4778-b764-d6cc05816f62 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3766dcb2-64ae-4dcc-b124-d83cd06c3121 (dataset): DatasetConfig { id: 3766dcb2-64ae-4dcc-b124-d83cd06c3121 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3bc769f7-bb6b-4409-ae50-1be6f6db5b5b (dataset): DatasetConfig { id: 3bc769f7-bb6b-4409-ae50-1be6f6db5b5b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d268a47-bb91-49b8-8f62-de8cc8678273 (dataset): DatasetConfig { id: 3d268a47-bb91-49b8-8f62-de8cc8678273 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d992123-c6a6-45f0-84d4-73ad487841f6 (dataset): DatasetConfig { id: 3d992123-c6a6-45f0-84d4-73ad487841f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 40ff59eb-86c4-4cf8-84a9-3eb2af8649fb (dataset): DatasetConfig { id: 40ff59eb-86c4-4cf8-84a9-3eb2af8649fb (dataset), name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43c31d20-4a38-4f59-882b-47883accad01 (dataset): DatasetConfig { id: 43c31d20-4a38-4f59-882b-47883accad01 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 477b1a05-a6c6-443d-b569-eedccb0fc4ea (dataset): DatasetConfig { id: 477b1a05-a6c6-443d-b569-eedccb0fc4ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48992aa5-ea60-4fa6-9b35-f405249405cc (dataset): DatasetConfig { id: 48992aa5-ea60-4fa6-9b35-f405249405cc (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4cbc1e90-5e55-40ad-816d-7420f45b5bda (dataset): DatasetConfig { id: 4cbc1e90-5e55-40ad-816d-7420f45b5bda (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 556d1415-8366-4cea-a3bc-f9283dcce541 (dataset): DatasetConfig { id: 556d1415-8366-4cea-a3bc-f9283dcce541 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58eadd21-fac5-41b2-b9bc-1c9b3a540600 (dataset): DatasetConfig { id: 58eadd21-fac5-41b2-b9bc-1c9b3a540600 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 619e4a7e-ed20-4c53-9ccf-16528c831d78 (dataset): DatasetConfig { id: 619e4a7e-ed20-4c53-9ccf-16528c831d78 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6536b2bf-a631-43f7-bafc-545b38759b69 (dataset): DatasetConfig { id: 6536b2bf-a631-43f7-bafc-545b38759b69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6b1c026e-181e-4056-aec0-060bb6ed4e4b (dataset): DatasetConfig { id: 6b1c026e-181e-4056-aec0-060bb6ed4e4b (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6ce766e6-d216-4e2a-b3af-a850994feebe (dataset): DatasetConfig { id: 6ce766e6-d216-4e2a-b3af-a850994feebe (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79f37152-c6e3-473e-ad55-4f77efb4e1de (dataset): DatasetConfig { id: 79f37152-c6e3-473e-ad55-4f77efb4e1de (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e21be7e-7b3b-420b-8556-9a2e626ca78f (dataset): DatasetConfig { id: 7e21be7e-7b3b-420b-8556-9a2e626ca78f (dataset), name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 83ee34c1-8f38-448f-a57d-59014a4f698f (dataset): DatasetConfig { id: 83ee34c1-8f38-448f-a57d-59014a4f698f (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8888abe2-f274-41b8-9251-265a67d066c8 (dataset): DatasetConfig { id: 8888abe2-f274-41b8-9251-265a67d066c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8d4e6adc-a501-426f-b467-05201ecb5659 (dataset): DatasetConfig { id: 8d4e6adc-a501-426f-b467-05201ecb5659 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9372be1d-6d9f-4a14-99d9-5112ce57c9e4 (dataset): DatasetConfig { id: 9372be1d-6d9f-4a14-99d9-5112ce57c9e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99823811-140e-4bb5-a867-08e57c80f044 (dataset): DatasetConfig { id: 99823811-140e-4bb5-a867-08e57c80f044 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fdfd265-2701-45a6-b65c-3ddb8e9cf5e6 (dataset): DatasetConfig { id: 9fdfd265-2701-45a6-b65c-3ddb8e9cf5e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5a56a80-c248-414c-be4a-3491ddbfdacd (dataset): DatasetConfig { id: a5a56a80-c248-414c-be4a-3491ddbfdacd (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac557138-69ef-40b3-86af-e708dd9246bc (dataset): DatasetConfig { id: ac557138-69ef-40b3-86af-e708dd9246bc (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b021a592-7cd6-47d7-9674-91ddd98205e8 (dataset): DatasetConfig { id: b021a592-7cd6-47d7-9674-91ddd98205e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b253e844-2a4f-4172-8ed6-7257e47916c3 (dataset): DatasetConfig { id: b253e844-2a4f-4172-8ed6-7257e47916c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2bf982a-6c25-4ad9-a3b1-0751b9e97506 (dataset): DatasetConfig { id: b2bf982a-6c25-4ad9-a3b1-0751b9e97506 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b412eae6-ef32-4f5a-9455-6f9797aa01b6 (dataset): DatasetConfig { id: b412eae6-ef32-4f5a-9455-6f9797aa01b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbb49b3f-11fe-4f85-88a9-4822085351f2 (dataset): DatasetConfig { id: bbb49b3f-11fe-4f85-88a9-4822085351f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77b629f-910d-4016-9911-a3a4e967283e (dataset): DatasetConfig { id: c77b629f-910d-4016-9911-a3a4e967283e (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc0094d5-f3a2-4cde-90fd-cabe4ac827c2 (dataset): DatasetConfig { id: cc0094d5-f3a2-4cde-90fd-cabe4ac827c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cdf68d97-8b08-4d15-b65c-a3f5e7de3a04 (dataset): DatasetConfig { id: cdf68d97-8b08-4d15-b65c-a3f5e7de3a04 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce7c44ff-1181-49f0-bd51-a56f525834ce (dataset): DatasetConfig { id: ce7c44ff-1181-49f0-bd51-a56f525834ce (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6b976a1-a535-473b-914f-d04b7f2e515d (dataset): DatasetConfig { id: d6b976a1-a535-473b-914f-d04b7f2e515d (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6f5e4f4-bfd9-4c0b-8d03-59e263d6664a (dataset): DatasetConfig { id: d6f5e4f4-bfd9-4c0b-8d03-59e263d6664a (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbe98178-71ad-4bb5-ad44-002b4a027eed (dataset): DatasetConfig { id: dbe98178-71ad-4bb5-ad44-002b4a027eed (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc22716f-1072-47c4-8e6e-4a77109f0e1d (dataset): DatasetConfig { id: dc22716f-1072-47c4-8e6e-4a77109f0e1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e05f4279-9737-473c-8236-75d2be697226 (dataset): DatasetConfig { id: e05f4279-9737-473c-8236-75d2be697226 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6db45e9-b95c-41df-8c16-44ed911b5602 (dataset): DatasetConfig { id: e6db45e9-b95c-41df-8c16-44ed911b5602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e76d7924-6894-47d5-8c53-8856311a5afd (dataset): DatasetConfig { id: e76d7924-6894-47d5-8c53-8856311a5afd (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee103ad7-c98e-4900-80bb-0abdc446ab61 (dataset): DatasetConfig { id: ee103ad7-c98e-4900-80bb-0abdc446ab61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee5c143c-86c6-49cc-a616-f87ddb163b67 (dataset): DatasetConfig { id: ee5c143c-86c6-49cc-a616-f87ddb163b67 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eeeb13fc-f2b0-4ad7-a095-fb0e7d24cb57 (dataset): DatasetConfig { id: eeeb13fc-f2b0-4ad7-a095-fb0e7d24cb57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef3c7da6-740f-4dee-abbe-7088a9d7c0a5 (dataset): DatasetConfig { id: ef3c7da6-740f-4dee-abbe-7088a9d7c0a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f13ee8af-6c1c-4e88-bedc-d074cb898225 (dataset): DatasetConfig { id: f13ee8af-6c1c-4e88-bedc-d074cb898225 (dataset), name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f29be477-5a3c-437a-9d2f-bc5a3308c38b (dataset): DatasetConfig { id: f29be477-5a3c-437a-9d2f-bc5a3308c38b (dataset), name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432024-12-21T00:43:51.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64671
4442024-12-21T00:43:51.303ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
4452024-12-21T00:43:51.303ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {027c63ce-473a-4f5e-bae9-4134238ed150 (dataset): DatasetConfig { id: 027c63ce-473a-4f5e-bae9-4134238ed150 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02d40cc9-e99f-4901-95ae-817723824a33 (dataset): DatasetConfig { id: 02d40cc9-e99f-4901-95ae-817723824a33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04319dde-fd2a-4f7c-9690-f6d496dfc31b (dataset): DatasetConfig { id: 04319dde-fd2a-4f7c-9690-f6d496dfc31b (dataset), name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b58521b-c5cf-42b8-99de-4508a6fee57e (dataset): DatasetConfig { id: 0b58521b-c5cf-42b8-99de-4508a6fee57e (dataset), name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b8ef02d-3441-4805-928c-273453965794 (dataset): DatasetConfig { id: 0b8ef02d-3441-4805-928c-273453965794 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0ced513c-5fbb-411f-b47b-5e9f8326aa72 (dataset): DatasetConfig { id: 0ced513c-5fbb-411f-b47b-5e9f8326aa72 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e2f020d-a5dc-4093-8a0c-509ad1c55630 (dataset): DatasetConfig { id: 0e2f020d-a5dc-4093-8a0c-509ad1c55630 (dataset), name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 103d60ba-978b-42cd-85d7-9ad55745756f (dataset): DatasetConfig { id: 103d60ba-978b-42cd-85d7-9ad55745756f (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10fcf612-1959-4410-b315-b019cc57a9bd (dataset): DatasetConfig { id: 10fcf612-1959-4410-b315-b019cc57a9bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 178bb4de-8328-4b4c-a398-135ab9c73756 (dataset): DatasetConfig { id: 178bb4de-8328-4b4c-a398-135ab9c73756 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1905c0ad-92d1-4ea2-9b86-58f01f584ce9 (dataset): DatasetConfig { id: 1905c0ad-92d1-4ea2-9b86-58f01f584ce9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19f2765c-9417-473f-a8b8-43d0f2d49d17 (dataset): DatasetConfig { id: 19f2765c-9417-473f-a8b8-43d0f2d49d17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b835633-a204-4f6d-8131-acf19923932f (dataset): DatasetConfig { id: 1b835633-a204-4f6d-8131-acf19923932f (dataset), name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1f570834-bcc0-4f5d-ab7f-130d9f74bdee (dataset): DatasetConfig { id: 1f570834-bcc0-4f5d-ab7f-130d9f74bdee (dataset), name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2bf5e34a-c30d-4876-b08c-a9bb6506d899 (dataset): DatasetConfig { id: 2bf5e34a-c30d-4876-b08c-a9bb6506d899 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e319c0f-400c-4736-9bd6-92dbc4f5a822 (dataset): DatasetConfig { id: 2e319c0f-400c-4736-9bd6-92dbc4f5a822 (dataset), name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ea49141-caf7-41a9-ad10-33a104e4f043 (dataset): DatasetConfig { id: 2ea49141-caf7-41a9-ad10-33a104e4f043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f91e164-59c8-4eae-bb64-ba103d55b200 (dataset): DatasetConfig { id: 2f91e164-59c8-4eae-bb64-ba103d55b200 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3241ab01-9aaf-4778-b764-d6cc05816f62 (dataset): DatasetConfig { id: 3241ab01-9aaf-4778-b764-d6cc05816f62 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3766dcb2-64ae-4dcc-b124-d83cd06c3121 (dataset): DatasetConfig { id: 3766dcb2-64ae-4dcc-b124-d83cd06c3121 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3bc769f7-bb6b-4409-ae50-1be6f6db5b5b (dataset): DatasetConfig { id: 3bc769f7-bb6b-4409-ae50-1be6f6db5b5b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d268a47-bb91-49b8-8f62-de8cc8678273 (dataset): DatasetConfig { id: 3d268a47-bb91-49b8-8f62-de8cc8678273 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d992123-c6a6-45f0-84d4-73ad487841f6 (dataset): DatasetConfig { id: 3d992123-c6a6-45f0-84d4-73ad487841f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 40ff59eb-86c4-4cf8-84a9-3eb2af8649fb (dataset): DatasetConfig { id: 40ff59eb-86c4-4cf8-84a9-3eb2af8649fb (dataset), name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43c31d20-4a38-4f59-882b-47883accad01 (dataset): DatasetConfig { id: 43c31d20-4a38-4f59-882b-47883accad01 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 477b1a05-a6c6-443d-b569-eedccb0fc4ea (dataset): DatasetConfig { id: 477b1a05-a6c6-443d-b569-eedccb0fc4ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48992aa5-ea60-4fa6-9b35-f405249405cc (dataset): DatasetConfig { id: 48992aa5-ea60-4fa6-9b35-f405249405cc (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4cbc1e90-5e55-40ad-816d-7420f45b5bda (dataset): DatasetConfig { id: 4cbc1e90-5e55-40ad-816d-7420f45b5bda (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 556d1415-8366-4cea-a3bc-f9283dcce541 (dataset): DatasetConfig { id: 556d1415-8366-4cea-a3bc-f9283dcce541 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58eadd21-fac5-41b2-b9bc-1c9b3a540600 (dataset): DatasetConfig { id: 58eadd21-fac5-41b2-b9bc-1c9b3a540600 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 619e4a7e-ed20-4c53-9ccf-16528c831d78 (dataset): DatasetConfig { id: 619e4a7e-ed20-4c53-9ccf-16528c831d78 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6536b2bf-a631-43f7-bafc-545b38759b69 (dataset): DatasetConfig { id: 6536b2bf-a631-43f7-bafc-545b38759b69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6b1c026e-181e-4056-aec0-060bb6ed4e4b (dataset): DatasetConfig { id: 6b1c026e-181e-4056-aec0-060bb6ed4e4b (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6ce766e6-d216-4e2a-b3af-a850994feebe (dataset): DatasetConfig { id: 6ce766e6-d216-4e2a-b3af-a850994feebe (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 79f37152-c6e3-473e-ad55-4f77efb4e1de (dataset): DatasetConfig { id: 79f37152-c6e3-473e-ad55-4f77efb4e1de (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e21be7e-7b3b-420b-8556-9a2e626ca78f (dataset): DatasetConfig { id: 7e21be7e-7b3b-420b-8556-9a2e626ca78f (dataset), name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 83ee34c1-8f38-448f-a57d-59014a4f698f (dataset): DatasetConfig { id: 83ee34c1-8f38-448f-a57d-59014a4f698f (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8888abe2-f274-41b8-9251-265a67d066c8 (dataset): DatasetConfig { id: 8888abe2-f274-41b8-9251-265a67d066c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8d4e6adc-a501-426f-b467-05201ecb5659 (dataset): DatasetConfig { id: 8d4e6adc-a501-426f-b467-05201ecb5659 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9372be1d-6d9f-4a14-99d9-5112ce57c9e4 (dataset): DatasetConfig { id: 9372be1d-6d9f-4a14-99d9-5112ce57c9e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 99823811-140e-4bb5-a867-08e57c80f044 (dataset): DatasetConfig { id: 99823811-140e-4bb5-a867-08e57c80f044 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fdfd265-2701-45a6-b65c-3ddb8e9cf5e6 (dataset): DatasetConfig { id: 9fdfd265-2701-45a6-b65c-3ddb8e9cf5e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5a56a80-c248-414c-be4a-3491ddbfdacd (dataset): DatasetConfig { id: a5a56a80-c248-414c-be4a-3491ddbfdacd (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac557138-69ef-40b3-86af-e708dd9246bc (dataset): DatasetConfig { id: ac557138-69ef-40b3-86af-e708dd9246bc (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b021a592-7cd6-47d7-9674-91ddd98205e8 (dataset): DatasetConfig { id: b021a592-7cd6-47d7-9674-91ddd98205e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b253e844-2a4f-4172-8ed6-7257e47916c3 (dataset): DatasetConfig { id: b253e844-2a4f-4172-8ed6-7257e47916c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2bf982a-6c25-4ad9-a3b1-0751b9e97506 (dataset): DatasetConfig { id: b2bf982a-6c25-4ad9-a3b1-0751b9e97506 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b412eae6-ef32-4f5a-9455-6f9797aa01b6 (dataset): DatasetConfig { id: b412eae6-ef32-4f5a-9455-6f9797aa01b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbb49b3f-11fe-4f85-88a9-4822085351f2 (dataset): DatasetConfig { id: bbb49b3f-11fe-4f85-88a9-4822085351f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c77b629f-910d-4016-9911-a3a4e967283e (dataset): DatasetConfig { id: c77b629f-910d-4016-9911-a3a4e967283e (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc0094d5-f3a2-4cde-90fd-cabe4ac827c2 (dataset): DatasetConfig { id: cc0094d5-f3a2-4cde-90fd-cabe4ac827c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cdf68d97-8b08-4d15-b65c-a3f5e7de3a04 (dataset): DatasetConfig { id: cdf68d97-8b08-4d15-b65c-a3f5e7de3a04 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce7c44ff-1181-49f0-bd51-a56f525834ce (dataset): DatasetConfig { id: ce7c44ff-1181-49f0-bd51-a56f525834ce (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6b976a1-a535-473b-914f-d04b7f2e515d (dataset): DatasetConfig { id: d6b976a1-a535-473b-914f-d04b7f2e515d (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6f5e4f4-bfd9-4c0b-8d03-59e263d6664a (dataset): DatasetConfig { id: d6f5e4f4-bfd9-4c0b-8d03-59e263d6664a (dataset), name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbe98178-71ad-4bb5-ad44-002b4a027eed (dataset): DatasetConfig { id: dbe98178-71ad-4bb5-ad44-002b4a027eed (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc22716f-1072-47c4-8e6e-4a77109f0e1d (dataset): DatasetConfig { id: dc22716f-1072-47c4-8e6e-4a77109f0e1d (dataset), name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e05f4279-9737-473c-8236-75d2be697226 (dataset): DatasetConfig { id: e05f4279-9737-473c-8236-75d2be697226 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6db45e9-b95c-41df-8c16-44ed911b5602 (dataset): DatasetConfig { id: e6db45e9-b95c-41df-8c16-44ed911b5602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e76d7924-6894-47d5-8c53-8856311a5afd (dataset): DatasetConfig { id: e76d7924-6894-47d5-8c53-8856311a5afd (dataset), name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee103ad7-c98e-4900-80bb-0abdc446ab61 (dataset): DatasetConfig { id: ee103ad7-c98e-4900-80bb-0abdc446ab61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee5c143c-86c6-49cc-a616-f87ddb163b67 (dataset): DatasetConfig { id: ee5c143c-86c6-49cc-a616-f87ddb163b67 (dataset), name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eeeb13fc-f2b0-4ad7-a095-fb0e7d24cb57 (dataset): DatasetConfig { id: eeeb13fc-f2b0-4ad7-a095-fb0e7d24cb57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef3c7da6-740f-4dee-abbe-7088a9d7c0a5 (dataset): DatasetConfig { id: ef3c7da6-740f-4dee-abbe-7088a9d7c0a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f13ee8af-6c1c-4e88-bedc-d074cb898225 (dataset): DatasetConfig { id: f13ee8af-6c1c-4e88-bedc-d074cb898225 (dataset), name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f29be477-5a3c-437a-9d2f-bc5a3308c38b (dataset): DatasetConfig { id: f29be477-5a3c-437a-9d2f-bc5a3308c38b (dataset), name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4462024-12-21T00:43:51.303ZINFOSledAgent (StorageManager): No ledger in /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472024-12-21T00:43:51.303ZINFOSledAgent (StorageManager): No ledger in /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-21T00:43:51.303ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4492024-12-21T00:43:51.318ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4502024-12-21T00:43:51.318ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4512024-12-21T00:43:51.318ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4522024-12-21T00:43:51.365ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532024-12-21T00:43:51.365ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4542024-12-21T00:43:51.365ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone/oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone/oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363" } file = sled-storage/src/manager.rs:1431
4552024-12-21T00:43:51.420ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562024-12-21T00:43:51.420ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4572024-12-21T00:43:51.420ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crypt/zone"), full_name: "oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crypt/zone" } file = sled-storage/src/manager.rs:1431
4582024-12-21T00:43:51.446ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592024-12-21T00:43:51.446ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4602024-12-21T00:43:51.446ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48447ed6-1b12-4e40-80f4-de14cb014d3b/crypt/zone/oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0"), full_name: "oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b/crypt/zone/oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0" } file = sled-storage/src/manager.rs:1431
4612024-12-21T00:43:51.502ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622024-12-21T00:43:51.502ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632024-12-21T00:43:51.502ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/zone/oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f"), full_name: "oxp_73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/zone/oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f" } file = sled-storage/src/manager.rs:1431
4642024-12-21T00:43:51.559ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652024-12-21T00:43:51.559ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662024-12-21T00:43:51.559ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone/oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone/oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90" } file = sled-storage/src/manager.rs:1431
4672024-12-21T00:43:51.586ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
4682024-12-21T00:43:51.614ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692024-12-21T00:43:51.614ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4702024-12-21T00:43:51.614ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crypt/zone/oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91"), full_name: "oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crypt/zone/oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91" } file = sled-storage/src/manager.rs:1431
4712024-12-21T00:43:51.672ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722024-12-21T00:43:51.672ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4732024-12-21T00:43:51.672ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b745a-6af3-41e8-a39a-73607778df7f/crypt/zone"), full_name: "oxp_d31b745a-6af3-41e8-a39a-73607778df7f/crypt/zone" } file = sled-storage/src/manager.rs:1431
4742024-12-21T00:43:51.699ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752024-12-21T00:43:51.699ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4762024-12-21T00:43:51.699ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/zone"), full_name: "oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/zone" } file = sled-storage/src/manager.rs:1431
4772024-12-21T00:43:51.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782024-12-21T00:43:51.726ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4792024-12-21T00:43:51.726ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/zone/oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed"), full_name: "oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/zone/oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed" } file = sled-storage/src/manager.rs:1431
4802024-12-21T00:43:51.784ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812024-12-21T00:43:51.784ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822024-12-21T00:43:51.784ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/zone/oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53"), full_name: "oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/zone/oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53" } file = sled-storage/src/manager.rs:1431
4832024-12-21T00:43:51.839ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842024-12-21T00:43:51.839ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4852024-12-21T00:43:51.839ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crucible" } file = sled-storage/src/manager.rs:1431
4862024-12-21T00:43:51.883ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872024-12-21T00:43:51.883ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4882024-12-21T00:43:51.883ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad39f336-254c-44ce-89e1-7fe99a201a7a/crypt/debug"), full_name: "oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a/crypt/debug" } file = sled-storage/src/manager.rs:1431
4892024-12-21T00:43:51.910ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902024-12-21T00:43:51.910ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4912024-12-21T00:43:51.910ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a/crucible" } file = sled-storage/src/manager.rs:1431
4922024-12-21T00:43:51.954ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932024-12-21T00:43:51.954ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942024-12-21T00:43:51.954ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b/crucible" } file = sled-storage/src/manager.rs:1431
4952024-12-21T00:43:51.999ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962024-12-21T00:43:51.999ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972024-12-21T00:43:51.999ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crypt/zone/oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9"), full_name: "oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crypt/zone/oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9" } file = sled-storage/src/manager.rs:1431
4982024-12-21T00:43:52.057ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992024-12-21T00:43:52.057ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5002024-12-21T00:43:52.057ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/zone/oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0"), full_name: "oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/zone/oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0" } file = sled-storage/src/manager.rs:1431
5012024-12-21T00:43:52.114ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022024-12-21T00:43:52.114ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032024-12-21T00:43:52.114ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c679f342-f128-44a0-ab2d-f59379b9850c/crypt/zone/oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), full_name: "oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crypt/zone/oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744" } file = sled-storage/src/manager.rs:1431
5042024-12-21T00:43:52.171ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052024-12-21T00:43:52.171ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062024-12-21T00:43:52.171ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crucible" } file = sled-storage/src/manager.rs:1431
5072024-12-21T00:43:52.217ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082024-12-21T00:43:52.217ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5092024-12-21T00:43:52.217ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone" } file = sled-storage/src/manager.rs:1431
5102024-12-21T00:43:52.244ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112024-12-21T00:43:52.244ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122024-12-21T00:43:52.244ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99/crucible" } file = sled-storage/src/manager.rs:1431
5132024-12-21T00:43:52.288ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142024-12-21T00:43:52.288ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5152024-12-21T00:43:52.288ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b745a-6af3-41e8-a39a-73607778df7f/crypt/zone/oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681"), full_name: "oxp_d31b745a-6af3-41e8-a39a-73607778df7f/crypt/zone/oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681" } file = sled-storage/src/manager.rs:1431
5162024-12-21T00:43:52.345ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172024-12-21T00:43:52.345ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5182024-12-21T00:43:52.345ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c679f342-f128-44a0-ab2d-f59379b9850c/crypt/debug"), full_name: "oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crypt/debug" } file = sled-storage/src/manager.rs:1431
5192024-12-21T00:43:52.376ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202024-12-21T00:43:52.376ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5212024-12-21T00:43:52.376ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad39f336-254c-44ce-89e1-7fe99a201a7a/crypt/zone"), full_name: "oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5222024-12-21T00:43:52.408ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232024-12-21T00:43:52.408ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5242024-12-21T00:43:52.408ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c679f342-f128-44a0-ab2d-f59379b9850c/crypt/zone"), full_name: "oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5252024-12-21T00:43:52.438ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262024-12-21T00:43:52.438ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5272024-12-21T00:43:52.438ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/zone/oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5"), full_name: "oxp_73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/zone/oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5" } file = sled-storage/src/manager.rs:1431
5282024-12-21T00:43:52.497ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292024-12-21T00:43:52.497ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5302024-12-21T00:43:52.497ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d31b745a-6af3-41e8-a39a-73607778df7f/crucible" } file = sled-storage/src/manager.rs:1431
5312024-12-21T00:43:52.546ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322024-12-21T00:43:52.546ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5332024-12-21T00:43:52.546ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5342024-12-21T00:43:52.588ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
5352024-12-21T00:43:52.597ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362024-12-21T00:43:52.597ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372024-12-21T00:43:52.597ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5382024-12-21T00:43:52.648ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392024-12-21T00:43:52.648ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402024-12-21T00:43:52.648ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5412024-12-21T00:43:52.697ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422024-12-21T00:43:52.697ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5432024-12-21T00:43:52.697ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5442024-12-21T00:43:52.747ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452024-12-21T00:43:52.747ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5462024-12-21T00:43:52.747ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/debug"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/debug" } file = sled-storage/src/manager.rs:1431
5472024-12-21T00:43:52.776ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482024-12-21T00:43:52.776ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5492024-12-21T00:43:52.776ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b745a-6af3-41e8-a39a-73607778df7f/crypt/debug"), full_name: "oxp_d31b745a-6af3-41e8-a39a-73607778df7f/crypt/debug" } file = sled-storage/src/manager.rs:1431
5502024-12-21T00:43:52.806ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512024-12-21T00:43:52.806ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5522024-12-21T00:43:52.806ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/zone"), full_name: "oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/zone" } file = sled-storage/src/manager.rs:1431
5532024-12-21T00:43:52.835ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542024-12-21T00:43:52.835ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5552024-12-21T00:43:52.835ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a/crucible" } file = sled-storage/src/manager.rs:1431
5562024-12-21T00:43:52.884ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572024-12-21T00:43:52.884ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5582024-12-21T00:43:52.884ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48447ed6-1b12-4e40-80f4-de14cb014d3b/crypt/debug"), full_name: "oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b/crypt/debug" } file = sled-storage/src/manager.rs:1431
5592024-12-21T00:43:52.913ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602024-12-21T00:43:52.914ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5612024-12-21T00:43:52.914ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/debug"), full_name: "oxp_73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/debug" } file = sled-storage/src/manager.rs:1431
5622024-12-21T00:43:52.943ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632024-12-21T00:43:52.943ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5642024-12-21T00:43:52.943ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/debug"), full_name: "oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/debug" } file = sled-storage/src/manager.rs:1431
5652024-12-21T00:43:52.971ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662024-12-21T00:43:52.971ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5672024-12-21T00:43:52.971ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone/oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone/oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66" } file = sled-storage/src/manager.rs:1431
5682024-12-21T00:43:53.033ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692024-12-21T00:43:53.033ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702024-12-21T00:43:53.033ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/zone/oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), full_name: "oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/zone/oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2" } file = sled-storage/src/manager.rs:1431
5712024-12-21T00:43:53.094ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722024-12-21T00:43:53.094ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5732024-12-21T00:43:53.094ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/zone/oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d"), full_name: "oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/zone/oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d" } file = sled-storage/src/manager.rs:1431
5742024-12-21T00:43:53.153ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752024-12-21T00:43:53.153ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5762024-12-21T00:43:53.153ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5772024-12-21T00:43:53.203ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5782024-12-21T00:43:53.203ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5792024-12-21T00:43:53.203ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/zone/oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761"), full_name: "oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/zone/oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761" } file = sled-storage/src/manager.rs:1431
5802024-12-21T00:43:53.262ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5812024-12-21T00:43:53.262ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5822024-12-21T00:43:53.262ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5832024-12-21T00:43:53.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842024-12-21T00:43:53.313ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5852024-12-21T00:43:53.313ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/zone"), full_name: "oxp_73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/zone" } file = sled-storage/src/manager.rs:1431
5862024-12-21T00:43:53.342ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872024-12-21T00:43:53.342ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5882024-12-21T00:43:53.342ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone/oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone/oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c" } file = sled-storage/src/manager.rs:1431
5892024-12-21T00:43:53.403ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902024-12-21T00:43:53.403ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912024-12-21T00:43:53.403ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/zone/oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34"), full_name: "oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/zone/oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34" } file = sled-storage/src/manager.rs:1431
5922024-12-21T00:43:53.464ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932024-12-21T00:43:53.464ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5942024-12-21T00:43:53.464ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/zone/oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f"), full_name: "oxp_73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/zone/oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f" } file = sled-storage/src/manager.rs:1431
5952024-12-21T00:43:53.524ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962024-12-21T00:43:53.524ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972024-12-21T00:43:53.524ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5982024-12-21T00:43:53.574ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992024-12-21T00:43:53.574ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6002024-12-21T00:43:53.574ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c679f342-f128-44a0-ab2d-f59379b9850c/crypt/zone/oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8"), full_name: "oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crypt/zone/oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8" } file = sled-storage/src/manager.rs:1431
6012024-12-21T00:43:53.590ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
6022024-12-21T00:43:53.637ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6032024-12-21T00:43:53.637ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6042024-12-21T00:43:53.637ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c679f342-f128-44a0-ab2d-f59379b9850c/crypt/zone/oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce"), full_name: "oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crypt/zone/oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce" } file = sled-storage/src/manager.rs:1431
6052024-12-21T00:43:53.698ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6062024-12-21T00:43:53.698ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6072024-12-21T00:43:53.698ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d31b745a-6af3-41e8-a39a-73607778df7f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6082024-12-21T00:43:53.748ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6092024-12-21T00:43:53.748ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6102024-12-21T00:43:53.748ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6112024-12-21T00:43:53.798ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6122024-12-21T00:43:53.798ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6132024-12-21T00:43:53.798ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_73f3806f-f01a-4ed9-9018-33c83b997a06/crucible" } file = sled-storage/src/manager.rs:1431
6142024-12-21T00:43:53.845ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6152024-12-21T00:43:53.845ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6162024-12-21T00:43:53.845ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c679f342-f128-44a0-ab2d-f59379b9850c/crypt/zone/oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3"), full_name: "oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crypt/zone/oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3" } file = sled-storage/src/manager.rs:1431
6172024-12-21T00:43:53.905ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6182024-12-21T00:43:53.905ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6192024-12-21T00:43:53.905ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/zone/oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7"), full_name: "oxp_73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/zone/oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7" } file = sled-storage/src/manager.rs:1431
6202024-12-21T00:43:53.963ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6212024-12-21T00:43:53.963ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6222024-12-21T00:43:53.963ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48447ed6-1b12-4e40-80f4-de14cb014d3b/crypt/zone/oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec"), full_name: "oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b/crypt/zone/oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec" } file = sled-storage/src/manager.rs:1431
6232024-12-21T00:43:54.023ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6242024-12-21T00:43:54.023ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6252024-12-21T00:43:54.023ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b745a-6af3-41e8-a39a-73607778df7f/crypt/zone/oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad"), full_name: "oxp_d31b745a-6af3-41e8-a39a-73607778df7f/crypt/zone/oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad" } file = sled-storage/src/manager.rs:1431
6262024-12-21T00:43:54.082ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6272024-12-21T00:43:54.082ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6282024-12-21T00:43:54.082ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crucible" } file = sled-storage/src/manager.rs:1431
6292024-12-21T00:43:54.131ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6302024-12-21T00:43:54.131ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6312024-12-21T00:43:54.131ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6322024-12-21T00:43:54.180ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6332024-12-21T00:43:54.180ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6342024-12-21T00:43:54.180ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone/oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073"), full_name: "oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/zone/oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073" } file = sled-storage/src/manager.rs:1431
6352024-12-21T00:43:54.243ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6362024-12-21T00:43:54.243ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6372024-12-21T00:43:54.243ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad39f336-254c-44ce-89e1-7fe99a201a7a/crypt/zone/oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1"), full_name: "oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a/crypt/zone/oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1" } file = sled-storage/src/manager.rs:1431
6382024-12-21T00:43:54.303ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6392024-12-21T00:43:54.303ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6402024-12-21T00:43:54.303ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/48447ed6-1b12-4e40-80f4-de14cb014d3b/crypt/zone"), full_name: "oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b/crypt/zone" } file = sled-storage/src/manager.rs:1431
6412024-12-21T00:43:54.332ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6422024-12-21T00:43:54.332ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6432024-12-21T00:43:54.332ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/debug"), full_name: "oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/debug" } file = sled-storage/src/manager.rs:1431
6442024-12-21T00:43:54.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6452024-12-21T00:43:54.362ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6462024-12-21T00:43:54.362ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crypt/debug"), full_name: "oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crypt/debug" } file = sled-storage/src/manager.rs:1431
6472024-12-21T00:43:54.391ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482024-12-21T00:43:54.391ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6492024-12-21T00:43:54.391ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ad39f336-254c-44ce-89e1-7fe99a201a7a/crypt/zone/oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929"), full_name: "oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a/crypt/zone/oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929" } file = sled-storage/src/manager.rs:1431
6502024-12-21T00:43:54.449ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512024-12-21T00:43:54.449ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522024-12-21T00:43:54.450ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
6532024-12-21T00:43:54.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3146964 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64671 req_id = 0d364c66-449e-4330-926c-5dbe9f6db438 response_code = 200 uri = /datasets
6542024-12-21T00:43:54.482ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: c203563c-056e-48c5-b713-c47dde4a4d66 (service), filesystem_pool: Some(ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3031f309-e2a3-47f1-ba66-c501b7457bce (service), filesystem_pool: Some(ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 4c6ed919-1d26-4ba3-bf59-669f633e02d7 (service), filesystem_pool: Some(ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6552024-12-21T00:43:54.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48185
6562024-12-21T00:43:54.482ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6572024-12-21T00:43:54.482ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: InternalDns }, responder: ... }
6582024-12-21T00:43:54.492ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592024-12-21T00:43:54.492ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602024-12-21T00:43:54.500ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612024-12-21T00:43:54.500ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622024-12-21T00:43:54.509ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6632024-12-21T00:43:54.509ZINFOSledAgent (ServiceManager): No ledger in /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:188
6642024-12-21T00:43:54.509ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:188
6652024-12-21T00:43:54.509ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662024-12-21T00:43:54.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672024-12-21T00:43:54.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682024-12-21T00:43:54.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692024-12-21T00:43:54.593ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
6702024-12-21T00:43:54.607ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7 file = illumos-utils/src/zone.rs:325
6712024-12-21T00:43:54.611ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce file = illumos-utils/src/zone.rs:325
6722024-12-21T00:43:54.615ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66 file = illumos-utils/src/zone.rs:325
6732024-12-21T00:43:54.626ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7 file = illumos-utils/src/zone.rs:363
6742024-12-21T00:43:54.630ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce file = illumos-utils/src/zone.rs:363
6752024-12-21T00:43:54.634ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66 file = illumos-utils/src/zone.rs:363
6762024-12-21T00:43:55.595ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
6772024-12-21T00:43:56.181ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782024-12-21T00:43:56.181ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6792024-12-21T00:43:56.181ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce
6802024-12-21T00:43:56.665ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812024-12-21T00:43:56.665ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6822024-12-21T00:43:57.147ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-12-21T00:43:57.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce") failed: Property not found. retry in 39.889762ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce
6842024-12-21T00:43:57.156ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66
6852024-12-21T00:43:57.160ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6862024-12-21T00:43:57.160ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7
6872024-12-21T00:43:57.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce") failed: Property not found. retry in 128.893456ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce
6882024-12-21T00:43:57.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66") failed: Property not found. retry in 61.415725ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66
6892024-12-21T00:43:57.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7") failed: Property not found. retry in 25.39903ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7
6902024-12-21T00:43:57.315ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6912024-12-21T00:43:57.315ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6922024-12-21T00:43:57.323ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6932024-12-21T00:43:57.323ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
6942024-12-21T00:43:57.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7") failed: Property not found. retry in 120.945652ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7
6952024-12-21T00:43:57.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce") failed: Property not found. retry in 247.109906ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce
6962024-12-21T00:43:57.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66") failed: Property not found. retry in 78.782385ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66
6972024-12-21T00:43:57.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7") failed: Property not found. retry in 276.877092ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7
6982024-12-21T00:43:57.657ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12700145215028865558 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
6992024-12-21T00:43:57.658ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3335878750386093462 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
7002024-12-21T00:43:57.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66") failed: Property not found. retry in 135.867993ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66
7012024-12-21T00:43:57.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce") failed: Property not found. retry in 361.852896ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce
7022024-12-21T00:43:57.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7") failed: Property not found. retry in 386.70205ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7
7032024-12-21T00:43:57.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66") failed: Property not found. retry in 264.05256ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66
7042024-12-21T00:43:57.888ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
7052024-12-21T00:43:57.888ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
7062024-12-21T00:43:57.933ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
7072024-12-21T00:43:57.933ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
7082024-12-21T00:43:57.998ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
7092024-12-21T00:43:57.998ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
7102024-12-21T00:43:58.023ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
7112024-12-21T00:43:58.023ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
7122024-12-21T00:43:58.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce") failed: Property not found. retry in 1.127521456s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce
7132024-12-21T00:43:58.101ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
7142024-12-21T00:43:58.101ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
7152024-12-21T00:43:58.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66") failed: Property not found. retry in 1.134045104s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66
7162024-12-21T00:43:58.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7") failed: Property not found. retry in 941.085124ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7
7172024-12-21T00:43:58.196ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
7182024-12-21T00:43:58.196ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7192024-12-21T00:43:58.230ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7202024-12-21T00:43:58.262ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7212024-12-21T00:43:58.262ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7222024-12-21T00:43:58.263ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7232024-12-21T00:43:58.263ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7242024-12-21T00:43:58.300ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
7252024-12-21T00:43:58.352ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7262024-12-21T00:43:58.352ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7272024-12-21T00:43:58.352ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7282024-12-21T00:43:58.352ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7292024-12-21T00:43:58.352ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7302024-12-21T00:43:58.352ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7312024-12-21T00:43:58.352ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7322024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7332024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7342024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7352024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7362024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7372024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7382024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7392024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7402024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7412024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7422024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7432024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7442024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7452024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7462024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7472024-12-21T00:43:58.353ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7482024-12-21T00:43:58.377ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
7492024-12-21T00:43:58.377ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
7502024-12-21T00:43:59.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7") failed: Property not found. retry in 1.395881535s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7
7512024-12-21T00:43:59.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce") failed: Property not found. retry in 693.750729ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce
7522024-12-21T00:43:59.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66") failed: Property not found. retry in 1.497121315s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66
7532024-12-21T00:43:59.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce") failed: Property not found. retry in 915.810378ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce
7542024-12-21T00:44:00.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7") failed: Property not found. retry in 502.626218ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7
7552024-12-21T00:44:00.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66") failed: Property not found. retry in 740.749921ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66
7562024-12-21T00:44:00.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce") failed: Property not found. retry in 1.122132337s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce
7572024-12-21T00:44:01.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7") failed: Property not found. retry in 770.660085ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7
7582024-12-21T00:44:01.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66") failed: Property not found. retry in 562.361857ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66
7592024-12-21T00:44:01.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7") failed: Property not found. retry in 835.101888ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7
7602024-12-21T00:44:02.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66") failed: Property not found. retry in 1.48702664s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66
7612024-12-21T00:44:03.597ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_4c6ed919-1d26-4ba3-bf59-669f633e02d7
7622024-12-21T00:44:03.597ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_3031f309-e2a3-47f1-ba66-c501b7457bce
7632024-12-21T00:44:03.597ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_c203563c-056e-48c5-b713-c47dde4a4d66
7642024-12-21T00:44:03.597ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7652024-12-21T00:44:03.597ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7662024-12-21T00:44:03.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9115289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48185 req_id = ae7a6a00-c216-4fd6-b1ba-fccfed5553fb response_code = 204 uri = /omicron-zones
7672024-12-21T00:44:03.600ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7682024-12-21T00:44:03.649ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7692024-12-21T00:44:03.703ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702024-12-21T00:44:03.749ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7712024-12-21T00:44:03.749ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7722024-12-21T00:44:03.782ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7732024-12-21T00:44:03.783ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7742024-12-21T00:44:03.783ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7752024-12-21T00:44:03.813ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: c203563c-056e-48c5-b713-c47dde4a4d66 (service), filesystem_pool: Some(ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3031f309-e2a3-47f1-ba66-c501b7457bce (service), filesystem_pool: Some(ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 4c6ed919-1d26-4ba3-bf59-669f633e02d7 (service), filesystem_pool: Some(ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: db86fcd6-9c69-4e00-a789-cfc69ae1c4d0 (service), filesystem_pool: Some(ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a885a1d0-b4f0-4f7f-9927-81fb20c10853, kind: Service { id: db86fcd6-9c69-4e00-a789-cfc69ae1c4d0 }, name: Name("ntp-db86fcd6-9c69-4e00-a789-cfc69ae1c4d0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 38])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7762024-12-21T00:44:03.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58423
7772024-12-21T00:44:03.813ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7782024-12-21T00:44:03.813ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: InternalDns }, responder: ... }
7792024-12-21T00:44:03.825ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7802024-12-21T00:44:03.825ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812024-12-21T00:44:03.835ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7822024-12-21T00:44:03.835ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7832024-12-21T00:44:03.845ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7842024-12-21T00:44:03.845ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:177
7852024-12-21T00:44:03.845ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:177
7862024-12-21T00:44:03.845ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7872024-12-21T00:44:03.857ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7882024-12-21T00:44:03.890ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7892024-12-21T00:44:03.890ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7902024-12-21T00:44:03.890ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7912024-12-21T00:44:03.920ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 208, 38]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7922024-12-21T00:44:03.920ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7932024-12-21T00:44:03.921ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7942024-12-21T00:44:03.921ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7952024-12-21T00:44:03.921ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7962024-12-21T00:44:03.921ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7972024-12-21T00:44:03.945ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0 file = illumos-utils/src/zone.rs:325
7982024-12-21T00:44:03.964ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0 file = illumos-utils/src/zone.rs:363
7992024-12-21T00:44:04.630ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8002024-12-21T00:44:04.630ZINFOSledAgent (ServiceManager): Booting oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8012024-12-21T00:44:04.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0") failed: Property not found. retry in 64.159338ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8022024-12-21T00:44:04.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0") failed: Property not found. retry in 62.427232ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8032024-12-21T00:44:04.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0") failed: Property not found. retry in 109.29917ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8042024-12-21T00:44:05.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0") failed: Property not found. retry in 249.577431ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8052024-12-21T00:44:05.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0") failed: Property not found. retry in 620.15503ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8062024-12-21T00:44:05.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0") failed: Property not found. retry in 896.749761ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8072024-12-21T00:44:06.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0") failed: Property not found. retry in 1.061322334s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8082024-12-21T00:44:07.660ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12700145215028865558 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8092024-12-21T00:44:07.660ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3335878750386093462 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8102024-12-21T00:44:07.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0") failed: Property not found. retry in 579.821449ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8112024-12-21T00:44:08.232ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/nexus.rs:527 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8122024-12-21T00:44:08.379ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8132024-12-21T00:44:08.379ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8142024-12-21T00:44:08.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0") failed: Property not found. retry in 611.124522ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8152024-12-21T00:44:09.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0") failed: Property not found. retry in 991.905598ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8162024-12-21T00:44:10.112ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0
8172024-12-21T00:44:10.112ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8182024-12-21T00:44:10.112ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8192024-12-21T00:44:10.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6299525 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58423 req_id = 75c349c2-4731-4aa1-9b01-2e12b5018ff9 response_code = 204 uri = /omicron-zones
8202024-12-21T00:44:10.116ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8212024-12-21T00:44:10.146ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8222024-12-21T00:44:10.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41368
8232024-12-21T00:44:10.154ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8242024-12-21T00:44:10.154ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7756 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41368 req_id = 9c4c8e04-6a30-4e44-89fe-84fa39b7e0ae response_code = 500 uri = /timesync
8252024-12-21T00:44:10.157ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8262024-12-21T00:44:10.301ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272024-12-21T00:44:10.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59977
8282024-12-21T00:44:11.970ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3879926801038825034 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8292024-12-21T00:44:12.697ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13131246539206561246 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8302024-12-21T00:44:13.600ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8968559058394622641 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8312024-12-21T00:44:14.310ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8322024-12-21T00:44:14.310ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59977 req_id = 16b700e1-4c6d-43cc-9c42-023464d70c03 response_code = 500 uri = /timesync
8332024-12-21T00:44:14.313ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8342024-12-21T00:44:14.486ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8352024-12-21T00:44:14.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59439
8362024-12-21T00:44:14.495ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8372024-12-21T00:44:14.495ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8831 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59439 req_id = cccf82c6-3460-43cb-871f-531e18b1b4fb response_code = 500 uri = /timesync
8382024-12-21T00:44:14.497ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8392024-12-21T00:44:14.730ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8402024-12-21T00:44:14.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62621
8412024-12-21T00:44:14.738ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_db86fcd6-9c69-4e00-a789-cfc69ae1c4d0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8422024-12-21T00:44:14.738ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62621 req_id = 35b06a8c-05f9-4fb9-9a67-b77f3a84b50f response_code = 500 uri = /timesync
8432024-12-21T00:44:14.742ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8442024-12-21T00:44:14.915ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8452024-12-21T00:44:14.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36494
8462024-12-21T00:44:18.473ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12700145215028865558 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8472024-12-21T00:44:18.473ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3335878750386093462 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8482024-12-21T00:44:19.405ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8492024-12-21T00:44:19.405ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8502024-12-21T00:44:19.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4009246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36494 req_id = 38cbbf22-ba47-4242-8864-b7f67d13624e response_code = 200 uri = /timesync
8512024-12-21T00:44:19.951ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.372882903 } file = sled-agent/src/rack_setup/service.rs:743
8522024-12-21T00:44:19.951ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532024-12-21T00:44:20.248ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542024-12-21T00:44:20.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49819
8552024-12-21T00:44:20.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8533 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49819 req_id = c2e88292-6283-4781-af6e-695addb5a1ad response_code = 200 uri = /timesync
8562024-12-21T00:44:20.260ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.379610121 } file = sled-agent/src/rack_setup/service.rs:743
8572024-12-21T00:44:20.260ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582024-12-21T00:44:20.561ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592024-12-21T00:44:20.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54686
8602024-12-21T00:44:20.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8688 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54686 req_id = d67e4362-8d57-4ca6-88ce-1d1fa50873de response_code = 200 uri = /timesync
8612024-12-21T00:44:20.573ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.37876007 } file = sled-agent/src/rack_setup/service.rs:743
8622024-12-21T00:44:20.573ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632024-12-21T00:44:20.785ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642024-12-21T00:44:20.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61920
8652024-12-21T00:44:20.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7952 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61920 req_id = 3bc045f5-5d17-4ce5-b34c-c9f1c94d8ed8 response_code = 200 uri = /timesync
8662024-12-21T00:44:20.795ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.378154069 } file = sled-agent/src/rack_setup/service.rs:743
8672024-12-21T00:44:20.795ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682024-12-21T00:44:21.136ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2935819178888037250 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8692024-12-21T00:44:21.136ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4271354811320306520 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8702024-12-21T00:44:21.199ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8712024-12-21T00:44:21.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57761
8722024-12-21T00:44:21.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8862 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57761 req_id = 78aaf1b9-94bb-48c9-a0aa-8aa0ebff3bbd response_code = 200 uri = /timesync
8732024-12-21T00:44:21.210ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.372091174 } file = sled-agent/src/rack_setup/service.rs:743
8742024-12-21T00:44:21.210ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8752024-12-21T00:44:21.636ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8762024-12-21T00:44:21.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39502
8772024-12-21T00:44:21.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39502 req_id = 17fed37c-4366-4380-bf33-6d99eda981ec response_code = 200 uri = /timesync
8782024-12-21T00:44:21.647ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.371123433 } file = sled-agent/src/rack_setup/service.rs:743
8792024-12-21T00:44:21.647ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8802024-12-21T00:44:22.204ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812024-12-21T00:44:22.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46473
8822024-12-21T00:44:22.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7726 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46473 req_id = ee2e0975-89da-44c8-a338-2c62266c25c3 response_code = 200 uri = /timesync
8832024-12-21T00:44:22.214ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.369582862 } file = sled-agent/src/rack_setup/service.rs:743
8842024-12-21T00:44:22.214ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8852024-12-21T00:44:22.874ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 235.851428ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8862024-12-21T00:44:23.001ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8872024-12-21T00:44:23.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44008
8882024-12-21T00:44:23.006ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3879926801038825034 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8892024-12-21T00:44:23.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9653 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44008 req_id = 6660e2a1-6472-4abe-947a-414e25830d1a response_code = 200 uri = /timesync
8902024-12-21T00:44:23.013ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.36757189 } file = sled-agent/src/rack_setup/service.rs:743
8912024-12-21T00:44:23.013ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8922024-12-21T00:44:23.520ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8932024-12-21T00:44:23.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43790
8942024-12-21T00:44:23.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8462 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43790 req_id = 3ea7242d-881c-432d-972b-76b8e7cf906e response_code = 200 uri = /timesync
8952024-12-21T00:44:23.530ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741862.8307877, correction: -0.366222471 } file = sled-agent/src/rack_setup/service.rs:743
8962024-12-21T00:44:23.530ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8972024-12-21T00:44:23.714ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13131246539206561246 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
8982024-12-21T00:44:24.515ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8992024-12-21T00:44:24.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33272
9002024-12-21T00:44:24.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9346 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33272 req_id = bcf89d02-269c-496e-be3a-5cf7bf5926b9 response_code = 200 uri = /timesync
9012024-12-21T00:44:24.528ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734741862.2504606, correction: -0.363145828 } file = sled-agent/src/rack_setup/service.rs:743
9022024-12-21T00:44:24.528ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9032024-12-21T00:44:24.614ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8968559058394622641 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9042024-12-21T00:44:25.547ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9052024-12-21T00:44:25.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54968
9062024-12-21T00:44:25.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8671 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54968 req_id = cbb116e8-7d2a-4f6b-a5c0-734e05911371 response_code = 200 uri = /timesync
9072024-12-21T00:44:25.559ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741864.31573, correction: -0.360062778 } file = sled-agent/src/rack_setup/service.rs:743
9082024-12-21T00:44:25.559ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9092024-12-21T00:44:27.239ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9102024-12-21T00:44:27.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48053
9112024-12-21T00:44:27.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8620 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48053 req_id = 72bd12b9-337c-4d95-aecb-7a901916b1f4 response_code = 200 uri = /timesync
9122024-12-21T00:44:27.253ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741865.5348375, correction: -0.355547726 } file = sled-agent/src/rack_setup/service.rs:743
9132024-12-21T00:44:27.253ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9142024-12-21T00:44:28.385ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9152024-12-21T00:44:28.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39284
9162024-12-21T00:44:28.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39284 req_id = 7b162186-8e8e-4533-b472-55a64046009e response_code = 200 uri = /timesync
9172024-12-21T00:44:28.396ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741866.3729565, correction: -0.352395892 } file = sled-agent/src/rack_setup/service.rs:743
9182024-12-21T00:44:28.396ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9192024-12-21T00:44:28.665ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12700145215028865558 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9202024-12-21T00:44:28.665ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3335878750386093462 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9212024-12-21T00:44:28.884ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60053
9222024-12-21T00:44:28.885ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60053 req_id = 80fa4f53-d6cd-421d-b3d8-62f67cdf5bfb response_code = 200 uri = /baseboard
9232024-12-21T00:44:29.382ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9242024-12-21T00:44:29.382ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9252024-12-21T00:44:29.933ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9262024-12-21T00:44:29.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59372
9272024-12-21T00:44:29.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59372 req_id = 30b25371-e8ca-4022-9e13-5db471edbf1c response_code = 200 uri = /timesync
9282024-12-21T00:44:29.946ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741868.600757, correction: -0.348151743 } file = sled-agent/src/rack_setup/service.rs:743
9292024-12-21T00:44:29.946ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9302024-12-21T00:44:31.111ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2935819178888037250 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9312024-12-21T00:44:31.111ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4271354811320306520 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9322024-12-21T00:44:32.841ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9332024-12-21T00:44:32.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38683
9342024-12-21T00:44:32.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9060 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38683 req_id = 249fdf45-693c-46f4-8bef-5fe99c589264 response_code = 200 uri = /timesync
9352024-12-21T00:44:32.852ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741871.7495267, correction: -0.340168983 } file = sled-agent/src/rack_setup/service.rs:743
9362024-12-21T00:44:32.852ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9372024-12-21T00:44:32.981ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3879926801038825034 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9382024-12-21T00:44:33.688ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13131246539206561246 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9392024-12-21T00:44:34.233ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9402024-12-21T00:44:34.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57873
9412024-12-21T00:44:34.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57873 req_id = 1186d16c-3b79-463e-ab09-968fd72299d1 response_code = 200 uri = /timesync
9422024-12-21T00:44:34.245ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741872.6874394, correction: -0.336327583 } file = sled-agent/src/rack_setup/service.rs:743
9432024-12-21T00:44:34.245ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9442024-12-21T00:44:34.589ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8968559058394622641 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9452024-12-21T00:44:37.078ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9462024-12-21T00:44:37.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47502
9472024-12-21T00:44:37.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8575 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47502 req_id = 904bf076-77aa-4f09-81a6-9eec088b03c3 response_code = 200 uri = /timesync
9482024-12-21T00:44:37.089ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741875.7947364, correction: -0.328601718 } file = sled-agent/src/rack_setup/service.rs:743
9492024-12-21T00:44:37.089ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9502024-12-21T00:44:38.104ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 398.631766ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9512024-12-21T00:44:38.640ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12700145215028865558 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9522024-12-21T00:44:38.640ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3335878750386093462 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9532024-12-21T00:44:39.358ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9542024-12-21T00:44:39.358ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9552024-12-21T00:44:41.086ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2935819178888037250 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9562024-12-21T00:44:41.086ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4271354811320306520 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9572024-12-21T00:44:42.413ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9582024-12-21T00:44:42.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51270
9592024-12-21T00:44:42.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9633 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51270 req_id = 623480a1-5b83-4c11-977d-7312f5781f51 response_code = 200 uri = /timesync
9602024-12-21T00:44:42.425ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741880.302982, correction: -0.314204007 } file = sled-agent/src/rack_setup/service.rs:743
9612024-12-21T00:44:42.425ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9622024-12-21T00:44:42.957ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3879926801038825034 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9632024-12-21T00:44:43.663ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13131246539206561246 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9642024-12-21T00:44:44.564ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8968559058394622641 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9652024-12-21T00:44:46.643ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9662024-12-21T00:44:46.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45225
9672024-12-21T00:44:46.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8467 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45225 req_id = 68d385d1-e333-4646-b20c-8cebc3b4209d response_code = 200 uri = /timesync
9682024-12-21T00:44:46.654ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741885.1210434, correction: -0.302761674 } file = sled-agent/src/rack_setup/service.rs:743
9692024-12-21T00:44:46.654ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9702024-12-21T00:44:48.616ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12700145215028865558 reason = Duration(60s) sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9712024-12-21T00:44:48.616ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3335878750386093462 reason = Duration(60s) sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9722024-12-21T00:44:49.334ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9732024-12-21T00:44:49.334ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9742024-12-21T00:44:50.188ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9752024-12-21T00:44:50.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49265
9762024-12-21T00:44:50.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8862 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49265 req_id = 04063238-6cd6-4832-b390-95cc2fec1b6d response_code = 200 uri = /timesync
9772024-12-21T00:44:50.201ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741888.903432, correction: -0.293150902 } file = sled-agent/src/rack_setup/service.rs:743
9782024-12-21T00:44:50.201ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9792024-12-21T00:44:51.061ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2935819178888037250 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9802024-12-21T00:44:51.061ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4271354811320306520 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9812024-12-21T00:44:52.933ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3879926801038825034 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9822024-12-21T00:44:53.497ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 625.548298ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9832024-12-21T00:44:53.639ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13131246539206561246 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9842024-12-21T00:44:54.539ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8968559058394622641 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9852024-12-21T00:44:56.718ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9862024-12-21T00:44:56.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63706
9872024-12-21T00:44:56.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8826 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63706 req_id = 532c5163-a13d-4a97-b428-89a838775661 response_code = 200 uri = /timesync
9882024-12-21T00:44:56.729ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741895.1369174, correction: -0.275408983 } file = sled-agent/src/rack_setup/service.rs:743
9892024-12-21T00:44:56.729ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9902024-12-21T00:44:58.836ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56346
9912024-12-21T00:44:58.836ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56346 req_id = db06bc36-5910-4103-8c86-d62b69bf097d response_code = 200 uri = /baseboard
9922024-12-21T00:44:59.308ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9932024-12-21T00:44:59.308ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9942024-12-21T00:45:01.037ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2935819178888037250 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9952024-12-21T00:45:01.037ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4271354811320306520 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9962024-12-21T00:45:02.908ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3879926801038825034 reason = Duration(60s) sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9972024-12-21T00:45:03.613ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13131246539206561246 reason = Duration(60s) sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9982024-12-21T00:45:04.514ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8968559058394622641 reason = Duration(60s) sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
9992024-12-21T00:45:05.505ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10002024-12-21T00:45:05.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36440
10012024-12-21T00:45:05.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8807 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36440 req_id = 574db3e1-c137-40fa-a2d4-2c37ddc1f25c response_code = 200 uri = /timesync
10022024-12-21T00:45:05.517ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741903.3648589, correction: -0.251522422 } file = sled-agent/src/rack_setup/service.rs:743
10032024-12-21T00:45:05.517ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10042024-12-21T00:45:09.116ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.928244808s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10052024-12-21T00:45:09.283ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10062024-12-21T00:45:09.283ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10072024-12-21T00:45:11.011ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2935819178888037250 reason = Duration(60s) sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10082024-12-21T00:45:11.011ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4271354811320306520 reason = Duration(60s) sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10092024-12-21T00:45:12.569ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10102024-12-21T00:45:12.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63640
10112024-12-21T00:45:12.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8708 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63640 req_id = 87e70694-23d5-4341-86e6-893eca6e1754 response_code = 200 uri = /timesync
10122024-12-21T00:45:12.580ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741911.0715735, correction: -0.232225165 } file = sled-agent/src/rack_setup/service.rs:743
10132024-12-21T00:45:12.580ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10142024-12-21T00:45:19.258ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10152024-12-21T00:45:19.259ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10162024-12-21T00:45:25.743ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10172024-12-21T00:45:25.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46264
10182024-12-21T00:45:25.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9326 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46264 req_id = a4340199-4da3-4983-aad8-97458cef9fd6 response_code = 200 uri = /timesync
10192024-12-21T00:45:25.756ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741923.354512, correction: -0.196573749 } file = sled-agent/src/rack_setup/service.rs:743
10202024-12-21T00:45:25.756ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10212024-12-21T00:45:26.035ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.397458937s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10222024-12-21T00:45:28.789ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61604
10232024-12-21T00:45:28.789ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61604 req_id = 69c23f42-4df9-4ae5-bfce-1c5dc964ce80 response_code = 200 uri = /baseboard
10242024-12-21T00:45:29.233ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10252024-12-21T00:45:29.233ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10262024-12-21T00:45:39.208ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10272024-12-21T00:45:39.208ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10282024-12-21T00:45:41.704ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10292024-12-21T00:45:41.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54923
10302024-12-21T00:45:41.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8801 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54923 req_id = 5a62e806-df72-4354-b66d-1aaed502c1d3 response_code = 200 uri = /timesync
10312024-12-21T00:45:41.715ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741935.162765, correction: -0.153326839 } file = sled-agent/src/rack_setup/service.rs:743
10322024-12-21T00:45:41.715ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10332024-12-21T00:45:44.418ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.442689676s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10342024-12-21T00:45:49.183ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10352024-12-21T00:45:49.183ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10362024-12-21T00:45:58.742ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50263
10372024-12-21T00:45:58.742ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50263 req_id = 5c9b43a9-c0cc-4f2e-864f-9c2507f90a75 response_code = 200 uri = /baseboard
10382024-12-21T00:45:59.158ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10392024-12-21T00:45:59.158ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10402024-12-21T00:46:01.129ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10412024-12-21T00:46:01.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37422
10422024-12-21T00:46:01.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37422 req_id = 818db6ab-16a3-40a8-acdb-9240aeaeafa0 response_code = 200 uri = /timesync
10432024-12-21T00:46:01.141ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741959.6150756, correction: -0.100621045 } file = sled-agent/src/rack_setup/service.rs:743
10442024-12-21T00:46:01.141ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10452024-12-21T00:46:09.134ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10462024-12-21T00:46:09.134ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10472024-12-21T00:46:10.824ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 21.167454522s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10482024-12-21T00:46:19.109ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13232448477036395665 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10492024-12-21T00:46:19.109ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4410342175184143088 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10502024-12-21T00:46:20.597ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10512024-12-21T00:46:20.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33046
10522024-12-21T00:46:20.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21375 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33046 req_id = 455f7c29-9fee-47ea-8e53-4f99261ad601 response_code = 200 uri = /timesync
10532024-12-21T00:46:20.620ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T00:44:48.616193381Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12700145215028865558 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10542024-12-21T00:46:20.621ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T00:45:03.613452566Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13131246539206561246 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10552024-12-21T00:46:20.621ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T00:45:11.011710786Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4271354811320306520 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10562024-12-21T00:46:20.621ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T00:45:02.908389639Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3879926801038825034 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10572024-12-21T00:46:20.621ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T00:45:11.011431411Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2935819178888037250 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10582024-12-21T00:46:20.622ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T00:45:04.514555690Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8968559058394622641 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10592024-12-21T00:46:20.622ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-21T00:44:48.616808362Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3335878750386093462 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
10602024-12-21T00:46:20.623ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734741976.3353353, correction: -0.047733672 } file = sled-agent/src/rack_setup/service.rs:743
10612024-12-21T00:46:20.623ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10622024-12-21T00:46:20.653ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: c203563c-056e-48c5-b713-c47dde4a4d66 (service), filesystem_pool: Some(ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3031f309-e2a3-47f1-ba66-c501b7457bce (service), filesystem_pool: Some(ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 4c6ed919-1d26-4ba3-bf59-669f633e02d7 (service), filesystem_pool: Some(ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: db86fcd6-9c69-4e00-a789-cfc69ae1c4d0 (service), filesystem_pool: Some(ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a885a1d0-b4f0-4f7f-9927-81fb20c10853, kind: Service { id: db86fcd6-9c69-4e00-a789-cfc69ae1c4d0 }, name: Name("ntp-db86fcd6-9c69-4e00-a789-cfc69ae1c4d0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 38])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 14265ee3-e3b0-45ac-94aa-e347b41cb363 (service), filesystem_pool: Some(ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External } } } }, OmicronZoneConfig { id: 085f6ea3-e6aa-4513-84d9-c0833184e3a8 (service), filesystem_pool: Some(ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External } } } }, OmicronZoneConfig { id: c9f22741-fce7-49f9-9103-0ba2e672594f (service), filesystem_pool: Some(ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5f8d59f4-9fd7-4d8d-ab89-9c3030566681 (service), filesystem_pool: Some(ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External } } } }, OmicronZoneConfig { id: c48f1447-4e85-40cb-9686-84fc3d1bbf53 (service), filesystem_pool: Some(ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10632024-12-21T00:46:20.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40464
10642024-12-21T00:46:20.653ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10652024-12-21T00:46:20.653ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: InternalDns }, responder: ... }
10662024-12-21T00:46:20.664ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10672024-12-21T00:46:20.664ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: InternalDns }, responder: ... }
10682024-12-21T00:46:20.674ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10692024-12-21T00:46:20.674ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10702024-12-21T00:46:20.683ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10712024-12-21T00:46:20.683ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10722024-12-21T00:46:20.692ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10732024-12-21T00:46:20.692ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Cockroach }, responder: ... }
10742024-12-21T00:46:20.701ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10752024-12-21T00:46:20.701ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10762024-12-21T00:46:20.711ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10772024-12-21T00:46:20.711ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10782024-12-21T00:46:20.720ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10792024-12-21T00:46:20.720ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10802024-12-21T00:46:20.729ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10812024-12-21T00:46:20.729ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:177
10822024-12-21T00:46:20.729ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:177
10832024-12-21T00:46:20.729ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10842024-12-21T00:46:20.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10852024-12-21T00:46:20.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10862024-12-21T00:46:20.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10872024-12-21T00:46:20.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10882024-12-21T00:46:20.809ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10892024-12-21T00:46:20.900ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363 file = illumos-utils/src/zone.rs:325
10902024-12-21T00:46:20.903ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 file = illumos-utils/src/zone.rs:325
10912024-12-21T00:46:20.907ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f file = illumos-utils/src/zone.rs:325
10922024-12-21T00:46:20.912ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53 file = illumos-utils/src/zone.rs:325
10932024-12-21T00:46:20.916ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681 file = illumos-utils/src/zone.rs:325
10942024-12-21T00:46:20.921ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363 file = illumos-utils/src/zone.rs:363
10952024-12-21T00:46:20.925ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 file = illumos-utils/src/zone.rs:363
10962024-12-21T00:46:20.929ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f file = illumos-utils/src/zone.rs:363
10972024-12-21T00:46:20.934ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53 file = illumos-utils/src/zone.rs:363
10982024-12-21T00:46:20.939ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681 file = illumos-utils/src/zone.rs:363
10992024-12-21T00:46:23.746ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='14265ee3-e3b0-45ac-94aa-e347b41cb363'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11002024-12-21T00:46:23.746ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11012024-12-21T00:46:23.763ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c48f1447-4e85-40cb-9686-84fc3d1bbf53'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11022024-12-21T00:46:23.763ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c9f22741-fce7-49f9-9103-0ba2e672594f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11032024-12-21T00:46:23.764ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11042024-12-21T00:46:23.769ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11052024-12-21T00:46:23.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 37.373102ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11062024-12-21T00:46:23.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 42.733124ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11072024-12-21T00:46:23.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 69.653935ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11082024-12-21T00:46:23.911ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5f8d59f4-9fd7-4d8d-ab89-9c3030566681'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11092024-12-21T00:46:23.911ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='085f6ea3-e6aa-4513-84d9-c0833184e3a8'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11102024-12-21T00:46:23.911ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11112024-12-21T00:46:23.916ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11122024-12-21T00:46:23.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 56.815201ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11132024-12-21T00:46:23.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 77.442853ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11142024-12-21T00:46:24.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 80.302569ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11152024-12-21T00:46:24.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 174.89281ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11162024-12-21T00:46:24.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 108.457813ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11172024-12-21T00:46:24.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 105.663573ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11182024-12-21T00:46:24.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 47.828629ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11192024-12-21T00:46:24.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 342.950296ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11202024-12-21T00:46:25.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 64.502736ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11212024-12-21T00:46:25.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 463.970037ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11222024-12-21T00:46:25.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 481.196842ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11232024-12-21T00:46:25.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 85.264855ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11242024-12-21T00:46:25.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 110.011322ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11252024-12-21T00:46:25.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 280.175516ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11262024-12-21T00:46:25.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 176.311335ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11272024-12-21T00:46:25.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 947.029583ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11282024-12-21T00:46:25.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 478.453976ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11292024-12-21T00:46:25.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 1.140572378s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11302024-12-21T00:46:25.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 278.689159ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11312024-12-21T00:46:25.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 673.876358ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11322024-12-21T00:46:25.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 675.036181ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11332024-12-21T00:46:26.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 563.373716ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11342024-12-21T00:46:26.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 1.091037753s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11352024-12-21T00:46:26.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 895.109173ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11362024-12-21T00:46:26.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 1.190370784s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11372024-12-21T00:46:26.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 995.680234ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11382024-12-21T00:46:26.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 563.499091ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11392024-12-21T00:46:27.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 756.042826ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11402024-12-21T00:46:27.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 1.467267366s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11412024-12-21T00:46:27.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 1.263065203s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11422024-12-21T00:46:27.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 848.673431ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11432024-12-21T00:46:27.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 992.349951ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11442024-12-21T00:46:27.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 1.356397299s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11452024-12-21T00:46:28.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 1.247570042s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11462024-12-21T00:46:28.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 1.350243217s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11472024-12-21T00:46:28.693ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47141
11482024-12-21T00:46:28.694ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47141 req_id = 7206a854-c656-4e65-9d79-d3eadf714f41 response_code = 200 uri = /baseboard
11492024-12-21T00:46:28.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 786.58599ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11502024-12-21T00:46:28.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 1.329041811s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11512024-12-21T00:46:29.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 1.008901529s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11522024-12-21T00:46:29.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 536.082104ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11532024-12-21T00:46:29.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 514.815709ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11542024-12-21T00:46:30.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 996.572236ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11552024-12-21T00:46:30.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 633.398882ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11562024-12-21T00:46:30.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 595.7104ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11572024-12-21T00:46:30.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 585.818176ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11582024-12-21T00:46:30.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 1.010924876s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11592024-12-21T00:46:30.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 643.100794ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11602024-12-21T00:46:30.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 1.153182386s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11612024-12-21T00:46:30.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 1.217324043s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11622024-12-21T00:46:31.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 1.310221482s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11632024-12-21T00:46:31.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 634.026713ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11642024-12-21T00:46:31.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 1.241796713s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11652024-12-21T00:46:31.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 785.673921ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11662024-12-21T00:46:32.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 978.598519ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11672024-12-21T00:46:32.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 1.088920441s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11682024-12-21T00:46:32.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 731.708953ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11692024-12-21T00:46:32.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 546.052286ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11702024-12-21T00:46:32.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 698.060741ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11712024-12-21T00:46:33.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 1.344211542s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11722024-12-21T00:46:33.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 1.410871488s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11732024-12-21T00:46:33.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 979.185311ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11742024-12-21T00:46:33.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 1.42379154s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11752024-12-21T00:46:33.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 1.400126001s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11762024-12-21T00:46:34.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 609.755988ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11772024-12-21T00:46:34.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 1.258031943s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11782024-12-21T00:46:34.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 661.356379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11792024-12-21T00:46:34.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 1.403026954s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11802024-12-21T00:46:34.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 1.207903297s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11812024-12-21T00:46:34.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 1.215517479s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11822024-12-21T00:46:35.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 1.471978481s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11832024-12-21T00:46:35.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 1.060871566s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11842024-12-21T00:46:35.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 1.249429776s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11852024-12-21T00:46:36.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 714.753288ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11862024-12-21T00:46:36.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 506.737447ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11872024-12-21T00:46:36.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 1.084418989s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11882024-12-21T00:46:36.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53") failed: Property not found. retry in 1.193881506s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
11892024-12-21T00:46:36.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 668.351438ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11902024-12-21T00:46:36.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 1.098073753s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11912024-12-21T00:46:37.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 791.943016ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11922024-12-21T00:46:37.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363") failed: Property not found. retry in 1.309594672s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11932024-12-21T00:46:37.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f") failed: Property not found. retry in 923.717631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11942024-12-21T00:46:37.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681") failed: Property not found. retry in 1.153341025s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
11952024-12-21T00:46:38.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8") failed: Property not found. retry in 958.375818ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11962024-12-21T00:46:39.043ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_14265ee3-e3b0-45ac-94aa-e347b41cb363
11972024-12-21T00:46:39.043ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8
11982024-12-21T00:46:39.043ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_c9f22741-fce7-49f9-9103-0ba2e672594f
11992024-12-21T00:46:39.043ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_c48f1447-4e85-40cb-9686-84fc3d1bbf53
12002024-12-21T00:46:39.043ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_5f8d59f4-9fd7-4d8d-ab89-9c3030566681
12012024-12-21T00:46:39.043ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12022024-12-21T00:46:39.043ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12032024-12-21T00:46:39.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18440326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40464 req_id = f3736ac4-1e45-45b3-9048-4d74864d2ecb response_code = 204 uri = /omicron-zones
12042024-12-21T00:46:39.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38393
12052024-12-21T00:46:39.117ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 34450 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = d0558abe-4e4a-4594-8b51-96c4ac4433e5 response_code = 500 uri = /cockroachdb
12062024-12-21T00:46:39.117ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d0558abe-4e4a-4594-8b51-96c4ac4433e5", "content-length": "124", "date": "Sat, 21 Dec 2024 00:46:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d0558abe-4e4a-4594-8b51-96c4ac4433e5" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 77.082334ms
12072024-12-21T00:46:39.222ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26060 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = 48357c57-ddaf-4a73-b9ab-ab053b85db27 response_code = 500 uri = /cockroachdb
12082024-12-21T00:46:39.222ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "48357c57-ddaf-4a73-b9ab-ab053b85db27", "content-length": "124", "date": "Sat, 21 Dec 2024 00:46:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "48357c57-ddaf-4a73-b9ab-ab053b85db27" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 178.618385ms
12092024-12-21T00:46:39.432ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29672 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = cd64a535-1b10-45a9-afc8-618642559385 response_code = 500 uri = /cockroachdb
12102024-12-21T00:46:39.432ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cd64a535-1b10-45a9-afc8-618642559385", "content-length": "124", "date": "Sat, 21 Dec 2024 00:46:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cd64a535-1b10-45a9-afc8-618642559385" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 214.00702ms
12112024-12-21T00:46:39.673ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26041 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = e973bb2f-b2a9-45e4-a79b-3bc089a64b51 response_code = 500 uri = /cockroachdb
12122024-12-21T00:46:39.673ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e973bb2f-b2a9-45e4-a79b-3bc089a64b51", "content-length": "124", "date": "Sat, 21 Dec 2024 00:46:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e973bb2f-b2a9-45e4-a79b-3bc089a64b51" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 108.244132ms
12132024-12-21T00:46:39.809ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = e96f6aef-90cb-4b71-bf37-dacbc0e3116f response_code = 500 uri = /cockroachdb
12142024-12-21T00:46:39.809ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e96f6aef-90cb-4b71-bf37-dacbc0e3116f", "content-length": "124", "date": "Sat, 21 Dec 2024 00:46:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e96f6aef-90cb-4b71-bf37-dacbc0e3116f" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 310.49397ms
12152024-12-21T00:46:40.147ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25858 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = b97a023a-4a88-457b-bd56-196755a34696 response_code = 500 uri = /cockroachdb
12162024-12-21T00:46:40.147ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b97a023a-4a88-457b-bd56-196755a34696", "content-length": "124", "date": "Sat, 21 Dec 2024 00:46:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b97a023a-4a88-457b-bd56-196755a34696" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 213.335787ms
12172024-12-21T00:46:40.389ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26905 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = 6ecf1e0e-a5eb-4654-887b-d747343f4051 response_code = 500 uri = /cockroachdb
12182024-12-21T00:46:40.389ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6ecf1e0e-a5eb-4654-887b-d747343f4051", "content-length": "124", "date": "Sat, 21 Dec 2024 00:46:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6ecf1e0e-a5eb-4654-887b-d747343f4051" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 152.204345ms
12192024-12-21T00:46:40.569ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26923 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = 7d17aafd-e3dc-4e18-94bb-050f604e5cf3 response_code = 500 uri = /cockroachdb
12202024-12-21T00:46:40.570ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7d17aafd-e3dc-4e18-94bb-050f604e5cf3", "content-length": "124", "date": "Sat, 21 Dec 2024 00:46:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7d17aafd-e3dc-4e18-94bb-050f604e5cf3" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 236.239443ms
12212024-12-21T00:46:40.835ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = e5b62835-020a-426c-accd-64aaddade71b response_code = 500 uri = /cockroachdb
12222024-12-21T00:46:40.835ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e5b62835-020a-426c-accd-64aaddade71b", "content-length": "124", "date": "Sat, 21 Dec 2024 00:46:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e5b62835-020a-426c-accd-64aaddade71b" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 387.235055ms
12232024-12-21T00:46:41.253ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = a3832453-145a-44df-808d-680197d51409 response_code = 500 uri = /cockroachdb
12242024-12-21T00:46:41.253ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a3832453-145a-44df-808d-680197d51409", "content-length": "124", "date": "Sat, 21 Dec 2024 00:46:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a3832453-145a-44df-808d-680197d51409" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 616.014952ms
12252024-12-21T00:46:41.897ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_085f6ea3-e6aa-4513-84d9-c0833184e3a8 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27325 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = 2c234425-5f02-4d67-9fa0-cc57466b0935 response_code = 500 uri = /cockroachdb
12262024-12-21T00:46:41.897ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2c234425-5f02-4d67-9fa0-cc57466b0935", "content-length": "124", "date": "Sat, 21 Dec 2024 00:46:41 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2c234425-5f02-4d67-9fa0-cc57466b0935" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 801.093805ms
12272024-12-21T00:46:42.734ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3758
12282024-12-21T00:46:58.788ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
12292024-12-21T00:47:04.330ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
12302024-12-21T00:47:04.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21629726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38393 req_id = 88c3e6d7-ed36-45d4-96fb-f6b7633b0638 response_code = 204 uri = /cockroachdb
12312024-12-21T00:47:04.332ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45121
12322024-12-21T00:47:04.333ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45121 req_id = ebe44e06-5b53-4e56-bccd-7ac320a08658 response_code = 200 uri = /baseboard
12332024-12-21T00:47:04.339ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 38.648980121s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
12342024-12-21T00:47:04.373ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: c203563c-056e-48c5-b713-c47dde4a4d66 (service), filesystem_pool: Some(ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3031f309-e2a3-47f1-ba66-c501b7457bce (service), filesystem_pool: Some(ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 4c6ed919-1d26-4ba3-bf59-669f633e02d7 (service), filesystem_pool: Some(ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: db86fcd6-9c69-4e00-a789-cfc69ae1c4d0 (service), filesystem_pool: Some(ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a885a1d0-b4f0-4f7f-9927-81fb20c10853, kind: Service { id: db86fcd6-9c69-4e00-a789-cfc69ae1c4d0 }, name: Name("ntp-db86fcd6-9c69-4e00-a789-cfc69ae1c4d0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 38])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 14265ee3-e3b0-45ac-94aa-e347b41cb363 (service), filesystem_pool: Some(ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External } } } }, OmicronZoneConfig { id: 085f6ea3-e6aa-4513-84d9-c0833184e3a8 (service), filesystem_pool: Some(ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External } } } }, OmicronZoneConfig { id: c9f22741-fce7-49f9-9103-0ba2e672594f (service), filesystem_pool: Some(ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5f8d59f4-9fd7-4d8d-ab89-9c3030566681 (service), filesystem_pool: Some(ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External } } } }, OmicronZoneConfig { id: c48f1447-4e85-40cb-9686-84fc3d1bbf53 (service), filesystem_pool: Some(ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External } } } }, OmicronZoneConfig { id: 9df62edf-ae77-467e-8386-2594d7931d90 (service), filesystem_pool: Some(ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: e8e123f1-5057-4c14-a500-5a66ca1807d8, kind: Service { id: 9df62edf-ae77-467e-8386-2594d7931d90 }, name: Name("external-dns-9df62edf-ae77-467e-8386-2594d7931d90"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 190])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 (service), filesystem_pool: Some(ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 6887e424-c467-4dc7-a8b3-00acc28971d2, kind: Service { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 }, name: Name("external-dns-3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 (service), filesystem_pool: Some(ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 150b0c67-783e-4dab-936e-88cb1fe1cda3, kind: Service { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 }, name: Name("nexus-176c56ae-3f0a-4c04-a40a-300d58486e34"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 3b31669e-ed79-4765-9f80-c063c63fac2d (service), filesystem_pool: Some(ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 104166fa-0281-40e0-a912-f30ba4e7f1c0, kind: Service { id: 3b31669e-ed79-4765-9f80-c063c63fac2d }, name: Name("nexus-3b31669e-ed79-4765-9f80-c063c63fac2d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 (service), filesystem_pool: Some(ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: c44fd269-5de0-4bbf-8a47-97be7cf8ce40, kind: Service { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 }, name: Name("nexus-af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 6d84d8d8-9b64-424a-b5f7-3073ed8bf761 (service), filesystem_pool: Some(ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: db6aef45-e599-452c-8c04-40a5c3a5879c (service), filesystem_pool: Some(ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External } } } }, OmicronZoneConfig { id: 4dd3d39e-1dd3-4070-9fa1-159571d59e2f (service), filesystem_pool: Some(ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 8184d1b0-c850-4a68-9ec0-f0dfc1290ad1 (service), filesystem_pool: Some(ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: b34affeb-a4cc-473c-8fb4-381bb3b4da91 (service), filesystem_pool: Some(ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 53889989-d09a-4ae2-a9ba-7db0bf231073 (service), filesystem_pool: Some(ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External } } } }, OmicronZoneConfig { id: 3347806f-91f1-4759-93a3-0ebbc51785b3 (service), filesystem_pool: Some(ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External } } } }, OmicronZoneConfig { id: c215f370-9263-4008-b5bd-586f117238f5 (service), filesystem_pool: Some(ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External } } } }, OmicronZoneConfig { id: 74b7cf96-dd99-473a-b00e-26ee605023ad (service), filesystem_pool: Some(ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External } } } }, OmicronZoneConfig { id: f897b3b6-8590-4a9b-9f19-0699730e2ab0 (service), filesystem_pool: Some(ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External } } } }, OmicronZoneConfig { id: 483af31e-ed94-4518-b616-4ec2dc232929 (service), filesystem_pool: Some(ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External } } } }, OmicronZoneConfig { id: e3773db0-2640-4087-964f-b0d35e1f81ed (service), filesystem_pool: Some(ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9d992651-fc2d-4371-a1df-244ce9f989f9 (service), filesystem_pool: Some(ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External } } } }, OmicronZoneConfig { id: b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec (service), filesystem_pool: Some(ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
12352024-12-21T00:47:04.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50504
12362024-12-21T00:47:04.374ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12372024-12-21T00:47:04.374ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: InternalDns }, responder: ... }
12382024-12-21T00:47:04.388ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12392024-12-21T00:47:04.388ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: InternalDns }, responder: ... }
12402024-12-21T00:47:04.399ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12412024-12-21T00:47:04.399ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12422024-12-21T00:47:04.411ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12432024-12-21T00:47:04.412ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Cockroach }, responder: ... }
12442024-12-21T00:47:04.423ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12452024-12-21T00:47:04.423ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Cockroach }, responder: ... }
12462024-12-21T00:47:04.433ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12472024-12-21T00:47:04.433ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12482024-12-21T00:47:04.444ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12492024-12-21T00:47:04.444ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Cockroach }, responder: ... }
12502024-12-21T00:47:04.455ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12512024-12-21T00:47:04.455ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Cockroach }, responder: ... }
12522024-12-21T00:47:04.464ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12532024-12-21T00:47:04.464ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12542024-12-21T00:47:04.477ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12552024-12-21T00:47:04.477ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12562024-12-21T00:47:04.488ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12572024-12-21T00:47:04.488ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12582024-12-21T00:47:04.500ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12592024-12-21T00:47:04.500ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, kind: Crucible }, responder: ... }
12602024-12-21T00:47:04.512ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12612024-12-21T00:47:04.512ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, kind: Crucible }, responder: ... }
12622024-12-21T00:47:04.524ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12632024-12-21T00:47:04.524ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, kind: Crucible }, responder: ... }
12642024-12-21T00:47:04.535ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12652024-12-21T00:47:04.535ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, kind: Crucible }, responder: ... }
12662024-12-21T00:47:04.547ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12672024-12-21T00:47:04.547ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, kind: Crucible }, responder: ... }
12682024-12-21T00:47:04.558ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12692024-12-21T00:47:04.558ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, kind: Crucible }, responder: ... }
12702024-12-21T00:47:04.570ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12712024-12-21T00:47:04.570ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, kind: Crucible }, responder: ... }
12722024-12-21T00:47:04.582ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12732024-12-21T00:47:04.582ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, kind: Crucible }, responder: ... }
12742024-12-21T00:47:04.593ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12752024-12-21T00:47:04.593ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, kind: Crucible }, responder: ... }
12762024-12-21T00:47:04.604ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12772024-12-21T00:47:04.604ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:177
12782024-12-21T00:47:04.604ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:177
12792024-12-21T00:47:04.604ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12802024-12-21T00:47:04.725ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12812024-12-21T00:47:04.742ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12822024-12-21T00:47:04.742ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12832024-12-21T00:47:04.744ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12842024-12-21T00:47:04.799ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12852024-12-21T00:47:04.800ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12862024-12-21T00:47:04.800ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12872024-12-21T00:47:04.800ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12882024-12-21T00:47:04.800ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12892024-12-21T00:47:04.828ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12902024-12-21T00:47:04.828ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12912024-12-21T00:47:05.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12922024-12-21T00:47:05.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12932024-12-21T00:47:05.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12942024-12-21T00:47:05.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12952024-12-21T00:47:05.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12962024-12-21T00:47:05.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12972024-12-21T00:47:05.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12982024-12-21T00:47:05.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12992024-12-21T00:47:05.023ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929 file = illumos-utils/src/zone.rs:325
13002024-12-21T00:47:05.028ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c file = illumos-utils/src/zone.rs:325
13012024-12-21T00:47:05.033ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3 file = illumos-utils/src/zone.rs:325
13022024-12-21T00:47:05.038ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9 file = illumos-utils/src/zone.rs:325
13032024-12-21T00:47:05.044ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad file = illumos-utils/src/zone.rs:325
13042024-12-21T00:47:05.050ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec file = illumos-utils/src/zone.rs:325
13052024-12-21T00:47:05.216ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929 file = illumos-utils/src/zone.rs:363
13062024-12-21T00:47:05.222ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c file = illumos-utils/src/zone.rs:363
13072024-12-21T00:47:05.227ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3 file = illumos-utils/src/zone.rs:363
13082024-12-21T00:47:05.231ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9 file = illumos-utils/src/zone.rs:363
13092024-12-21T00:47:05.236ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad file = illumos-utils/src/zone.rs:363
13102024-12-21T00:47:05.242ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec file = illumos-utils/src/zone.rs:363
13112024-12-21T00:47:05.248ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed file = illumos-utils/src/zone.rs:325
13122024-12-21T00:47:05.254ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761 file = illumos-utils/src/zone.rs:325
13132024-12-21T00:47:05.259ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073 file = illumos-utils/src/zone.rs:325
13142024-12-21T00:47:05.265ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91 file = illumos-utils/src/zone.rs:325
13152024-12-21T00:47:05.270ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5 file = illumos-utils/src/zone.rs:325
13162024-12-21T00:47:05.276ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1 file = illumos-utils/src/zone.rs:325
13172024-12-21T00:47:05.280ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0 file = illumos-utils/src/zone.rs:325
13182024-12-21T00:47:05.285ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f file = illumos-utils/src/zone.rs:325
13192024-12-21T00:47:05.340ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13202024-12-21T00:47:05.340ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed file = illumos-utils/src/zone.rs:363
13212024-12-21T00:47:05.349ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761 file = illumos-utils/src/zone.rs:363
13222024-12-21T00:47:05.356ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073 file = illumos-utils/src/zone.rs:363
13232024-12-21T00:47:05.364ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91 file = illumos-utils/src/zone.rs:363
13242024-12-21T00:47:05.371ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5 file = illumos-utils/src/zone.rs:363
13252024-12-21T00:47:05.379ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1 file = illumos-utils/src/zone.rs:363
13262024-12-21T00:47:05.387ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0 file = illumos-utils/src/zone.rs:363
13272024-12-21T00:47:05.395ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f file = illumos-utils/src/zone.rs:363
13282024-12-21T00:47:05.460ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13292024-12-21T00:47:05.517ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13302024-12-21T00:47:05.572ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13312024-12-21T00:47:05.627ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13322024-12-21T00:47:05.632ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13332024-12-21T00:47:05.632ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13342024-12-21T00:47:05.685ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 212, 181]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13352024-12-21T00:47:05.685ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
13362024-12-21T00:47:05.687ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13372024-12-21T00:47:05.687ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13382024-12-21T00:47:05.740ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 166, 190]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13392024-12-21T00:47:05.740ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
13402024-12-21T00:47:05.741ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13412024-12-21T00:47:05.741ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13422024-12-21T00:47:05.794ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 178, 40]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13432024-12-21T00:47:05.794ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13442024-12-21T00:47:05.796ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13452024-12-21T00:47:05.796ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13462024-12-21T00:47:05.850ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 255, 66]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13472024-12-21T00:47:05.850ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13482024-12-21T00:47:05.851ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13492024-12-21T00:47:05.851ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13502024-12-21T00:47:05.904ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 167, 57]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13512024-12-21T00:47:05.904ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13522024-12-21T00:47:05.908ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
13532024-12-21T00:47:05.908ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
13542024-12-21T00:47:05.908ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
13552024-12-21T00:47:05.908ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
13562024-12-21T00:47:05.908ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
13572024-12-21T00:47:05.908ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
13582024-12-21T00:47:05.908ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
13592024-12-21T00:47:05.908ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
13602024-12-21T00:47:05.908ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
13612024-12-21T00:47:05.908ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
13622024-12-21T00:47:05.909ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
13632024-12-21T00:47:05.911ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
13642024-12-21T00:47:05.913ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
13652024-12-21T00:47:05.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13662024-12-21T00:47:05.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13672024-12-21T00:47:05.916ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13682024-12-21T00:47:05.916ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
13692024-12-21T00:47:05.919ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
13702024-12-21T00:47:05.921ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13712024-12-21T00:47:05.930ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13722024-12-21T00:47:06.240ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 file = illumos-utils/src/zone.rs:325
13732024-12-21T00:47:06.253ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d file = illumos-utils/src/zone.rs:325
13742024-12-21T00:47:06.264ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744 file = illumos-utils/src/zone.rs:325
13752024-12-21T00:47:06.282ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90 file = illumos-utils/src/zone.rs:325
13762024-12-21T00:47:06.295ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34 file = illumos-utils/src/zone.rs:325
13772024-12-21T00:47:06.307ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 file = illumos-utils/src/zone.rs:363
13782024-12-21T00:47:06.317ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d file = illumos-utils/src/zone.rs:363
13792024-12-21T00:47:06.334ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744 file = illumos-utils/src/zone.rs:363
13802024-12-21T00:47:06.346ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90 file = illumos-utils/src/zone.rs:363
13812024-12-21T00:47:06.359ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34 file = illumos-utils/src/zone.rs:363
13822024-12-21T00:47:15.367ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0275c1f8-5561-47dd-ba8b-08cd93e6afc4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13832024-12-21T00:47:15.374ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d31b745a-6af3-41e8-a39a-73607778df7f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2340b47f-a284-416c-ac43-8036e77df5e6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13842024-12-21T00:47:15.375ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7aa2ee79-29c1-46ea-87f6-ba0a975725c8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13852024-12-21T00:47:15.379ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_73f3806f-f01a-4ed9-9018-33c83b997a06/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c6487577-fe31-464b-b2e7-9601d8406836'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13862024-12-21T00:47:15.380ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='62b8666a-402f-4d00-93e6-7b7310a7bf51'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13872024-12-21T00:47:15.381ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c679f342-f128-44a0-ab2d-f59379b9850c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='11f7ea85-508e-49f2-ab79-c47f02b4c531'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13882024-12-21T00:47:15.381ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
13892024-12-21T00:47:15.402ZINFOSledAgent (ServiceManager): Booting oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
13902024-12-21T00:47:15.417ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
13912024-12-21T00:47:15.426ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
13922024-12-21T00:47:15.436ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
13932024-12-21T00:47:15.445ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
13942024-12-21T00:47:15.461ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d361babe-f5ec-4b17-982e-6264a92d966e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13952024-12-21T00:47:15.462ZINFOSledAgent (ServiceManager): Booting oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
13962024-12-21T00:47:15.483ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13972024-12-21T00:47:15.483ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
13982024-12-21T00:47:15.494ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13992024-12-21T00:47:15.496ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14002024-12-21T00:47:15.496ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
14012024-12-21T00:47:15.507ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
14022024-12-21T00:47:15.757ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_590ffd4f-3c08-4aaa-9320-324eceef269f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ec08f011-3b0e-4f60-bf25-69583eb9576d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14032024-12-21T00:47:15.757ZINFOSledAgent (ServiceManager): Booting oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
14042024-12-21T00:47:15.988ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b81ba2f9-aa0b-43c6-82ee-235357f9fb86'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14052024-12-21T00:47:15.988ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
14062024-12-21T00:47:16.122ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14072024-12-21T00:47:16.122ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
14082024-12-21T00:47:16.134ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14092024-12-21T00:47:16.135ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
14102024-12-21T00:47:16.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 40.231313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
14112024-12-21T00:47:16.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 66.171732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
14122024-12-21T00:47:16.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 50.532872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
14132024-12-21T00:47:16.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 50.00144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
14142024-12-21T00:47:16.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 54.065126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
14152024-12-21T00:47:16.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 46.425542ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
14162024-12-21T00:47:16.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 63.889287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
14172024-12-21T00:47:16.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 63.900025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
14182024-12-21T00:47:16.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 116.991046ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
14192024-12-21T00:47:16.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 40.63298ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
14202024-12-21T00:47:16.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 77.65379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
14212024-12-21T00:47:16.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 91.72169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
14222024-12-21T00:47:16.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 53.366973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
14232024-12-21T00:47:16.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 58.190081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
14242024-12-21T00:47:16.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 69.185173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
14252024-12-21T00:47:16.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 104.293179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
14262024-12-21T00:47:16.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 128.389792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
14272024-12-21T00:47:16.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 72.36148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
14282024-12-21T00:47:16.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 71.242279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
14292024-12-21T00:47:16.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 122.83856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
14302024-12-21T00:47:16.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 47.380754ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
14312024-12-21T00:47:16.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 289.093369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
14322024-12-21T00:47:16.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 56.403061ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
14332024-12-21T00:47:17.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 286.038458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
14342024-12-21T00:47:17.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 241.343945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
14352024-12-21T00:47:17.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 156.322037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
14362024-12-21T00:47:17.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 52.488366ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
14372024-12-21T00:47:17.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 124.628595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
14382024-12-21T00:47:17.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 127.531393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
14392024-12-21T00:47:17.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 104.252334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
14402024-12-21T00:47:17.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 173.973528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
14412024-12-21T00:47:17.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 143.543352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
14422024-12-21T00:47:17.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 131.342612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
14432024-12-21T00:47:17.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 199.454218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
14442024-12-21T00:47:17.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 146.100723ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
14452024-12-21T00:47:17.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 211.388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
14462024-12-21T00:47:17.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 586.674183ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
14472024-12-21T00:47:17.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 106.196457ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
14482024-12-21T00:47:17.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 217.203053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
14492024-12-21T00:47:17.261ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='6d84d8d8-9b64-424a-b5f7-3073ed8bf761'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14502024-12-21T00:47:17.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 285.810857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
14512024-12-21T00:47:17.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 547.646399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
14522024-12-21T00:47:17.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 347.047265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
14532024-12-21T00:47:17.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 269.464997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
14542024-12-21T00:47:17.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 399.35129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
14552024-12-21T00:47:17.328ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
14562024-12-21T00:47:17.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 582.227053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
14572024-12-21T00:47:17.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 283.86758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
14582024-12-21T00:47:17.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 246.355852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
14592024-12-21T00:47:17.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 203.676997ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
14602024-12-21T00:47:17.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 255.004345ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
14612024-12-21T00:47:17.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 268.43508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
14622024-12-21T00:47:17.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 427.397632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
14632024-12-21T00:47:17.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 401.097675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
14642024-12-21T00:47:17.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 334.252663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
14652024-12-21T00:47:17.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 606.826391ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
14662024-12-21T00:47:17.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 62.653703ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
14672024-12-21T00:47:17.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 524.960231ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
14682024-12-21T00:47:17.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 517.113812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
14692024-12-21T00:47:17.648ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14702024-12-21T00:47:17.648ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
14712024-12-21T00:47:17.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 348.827293ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
14722024-12-21T00:47:17.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 485.675512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
14732024-12-21T00:47:17.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 561.975032ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
14742024-12-21T00:47:17.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 136.492092ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
14752024-12-21T00:47:17.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 825.291169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
14762024-12-21T00:47:17.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 764.685489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
14772024-12-21T00:47:17.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 657.343654ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
14782024-12-21T00:47:17.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 902.150492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
14792024-12-21T00:47:17.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 228.291731ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
14802024-12-21T00:47:17.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 1.036282978s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
14812024-12-21T00:47:18.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 563.161776ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
14822024-12-21T00:47:18.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 462.19044ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
14832024-12-21T00:47:18.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 1.00966626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
14842024-12-21T00:47:18.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 1.122358186s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
14852024-12-21T00:47:18.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 38.249155ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
14862024-12-21T00:47:18.094ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14872024-12-21T00:47:18.095ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14882024-12-21T00:47:18.095ZINFOSledAgent (ServiceManager): Booting oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
14892024-12-21T00:47:18.103ZINFOSledAgent (ServiceManager): Booting oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
14902024-12-21T00:47:18.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 108.89828ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
14912024-12-21T00:47:18.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 504.754007ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
14922024-12-21T00:47:18.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.239076306s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
14932024-12-21T00:47:18.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 1.383788612s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
14942024-12-21T00:47:18.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 1.310179857s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
14952024-12-21T00:47:18.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 205.491735ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
14962024-12-21T00:47:18.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 467.435117ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
14972024-12-21T00:47:18.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 597.900781ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
14982024-12-21T00:47:18.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 61.544762ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
14992024-12-21T00:47:18.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 34.935592ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
15002024-12-21T00:47:18.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 64.783729ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
15012024-12-21T00:47:18.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 70.344879ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
15022024-12-21T00:47:18.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 1.158744308s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
15032024-12-21T00:47:18.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 431.724805ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
15042024-12-21T00:47:18.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 119.863479ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
15052024-12-21T00:47:18.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 168.965201ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
15062024-12-21T00:47:18.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 883.391704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
15072024-12-21T00:47:18.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 1.048084186s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
15082024-12-21T00:47:18.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 1.493524646s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
15092024-12-21T00:47:18.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 617.637635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
15102024-12-21T00:47:18.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.14721554s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
15112024-12-21T00:47:18.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 356.468865ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
15122024-12-21T00:47:18.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 571.720959ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
15132024-12-21T00:47:18.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 1.086543994s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
15142024-12-21T00:47:18.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 700.045088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
15152024-12-21T00:47:18.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 920.848572ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
15162024-12-21T00:47:18.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 1.1687893s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
15172024-12-21T00:47:19.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 1.458128732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
15182024-12-21T00:47:19.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 1.15009945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
15192024-12-21T00:47:19.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 672.585532ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
15202024-12-21T00:47:19.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 1.000711561s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
15212024-12-21T00:47:19.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 867.192168ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
15222024-12-21T00:47:19.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 938.936961ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
15232024-12-21T00:47:19.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 621.267298ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
15242024-12-21T00:47:19.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 653.802028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
15252024-12-21T00:47:19.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 1.211231873s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
15262024-12-21T00:47:19.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 560.284624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
15272024-12-21T00:47:19.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 1.255647629s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
15282024-12-21T00:47:19.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 981.981226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
15292024-12-21T00:47:19.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 872.92549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
15302024-12-21T00:47:19.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 1.075137225s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
15312024-12-21T00:47:19.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.009609274s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
15322024-12-21T00:47:19.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 719.572413ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
15332024-12-21T00:47:19.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 1.017829916s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
15342024-12-21T00:47:20.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.439616604s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
15352024-12-21T00:47:20.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 862.023487ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
15362024-12-21T00:47:20.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 629.98168ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
15372024-12-21T00:47:20.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 1.307174851s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
15382024-12-21T00:47:20.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 520.856973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
15392024-12-21T00:47:20.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 1.496388376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
15402024-12-21T00:47:20.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 1.197054142s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
15412024-12-21T00:47:20.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 982.595822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
15422024-12-21T00:47:20.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 1.092721984s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
15432024-12-21T00:47:20.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 997.693467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
15442024-12-21T00:47:20.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 571.236837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
15452024-12-21T00:47:20.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 839.68445ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
15462024-12-21T00:47:20.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 1.27570331s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
15472024-12-21T00:47:20.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 718.361895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
15482024-12-21T00:47:20.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 1.190077066s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
15492024-12-21T00:47:20.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 1.266632151s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
15502024-12-21T00:47:20.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 1.011735785s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
15512024-12-21T00:47:20.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 837.408232ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
15522024-12-21T00:47:20.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 1.167412999s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
15532024-12-21T00:47:20.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 873.50513ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
15542024-12-21T00:47:21.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 697.237786ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
15552024-12-21T00:47:21.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 1.26100828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
15562024-12-21T00:47:21.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 838.555829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
15572024-12-21T00:47:21.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 550.622064ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
15582024-12-21T00:47:21.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 1.208427222s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
15592024-12-21T00:47:21.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 1.143920974s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
15602024-12-21T00:47:21.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 1.269836004s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
15612024-12-21T00:47:21.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 1.499475934s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
15622024-12-21T00:47:21.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 1.282804295s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
15632024-12-21T00:47:21.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.037111102s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
15642024-12-21T00:47:21.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 1.070343029s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
15652024-12-21T00:47:21.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 554.27514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
15662024-12-21T00:47:21.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.488459776s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
15672024-12-21T00:47:21.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 995.624712ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
15682024-12-21T00:47:21.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 1.464820978s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
15692024-12-21T00:47:21.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 951.068014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
15702024-12-21T00:47:21.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 544.459765ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
15712024-12-21T00:47:21.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 705.002054ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
15722024-12-21T00:47:22.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 1.074242423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
15732024-12-21T00:47:22.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 849.418189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
15742024-12-21T00:47:22.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 1.393885085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
15752024-12-21T00:47:22.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 1.377503981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
15762024-12-21T00:47:22.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 741.453993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
15772024-12-21T00:47:22.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 1.030224627s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
15782024-12-21T00:47:22.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 508.613448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
15792024-12-21T00:47:22.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 677.785252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
15802024-12-21T00:47:22.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 942.590798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
15812024-12-21T00:47:22.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 614.050506ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
15822024-12-21T00:47:22.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 629.007614ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
15832024-12-21T00:47:22.756ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15842024-12-21T00:47:22.757ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
15852024-12-21T00:47:22.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 1.198164585s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
15862024-12-21T00:47:22.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 1.278844273s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
15872024-12-21T00:47:22.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 743.227248ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
15882024-12-21T00:47:22.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 879.842663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
15892024-12-21T00:47:22.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 690.818569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
15902024-12-21T00:47:22.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 696.680143ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
15912024-12-21T00:47:23.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 42.815472ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
15922024-12-21T00:47:23.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.347631584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
15932024-12-21T00:47:23.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 98.499419ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
15942024-12-21T00:47:23.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 916.335362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
15952024-12-21T00:47:23.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 1.44838435s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
15962024-12-21T00:47:23.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 691.937197ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
15972024-12-21T00:47:23.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 237.79528ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
15982024-12-21T00:47:23.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 595.075692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
15992024-12-21T00:47:23.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 1.43764273s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
16002024-12-21T00:47:23.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 1.148270297s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
16012024-12-21T00:47:23.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 1.277161441s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
16022024-12-21T00:47:23.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 207.890452ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
16032024-12-21T00:47:23.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 1.346132566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
16042024-12-21T00:47:23.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 778.047941ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
16052024-12-21T00:47:23.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 814.58207ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
16062024-12-21T00:47:23.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 916.293946ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
16072024-12-21T00:47:23.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 1.230083371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
16082024-12-21T00:47:23.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 1.334566829s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
16092024-12-21T00:47:23.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 722.608437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
16102024-12-21T00:47:23.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 608.349027ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
16112024-12-21T00:47:23.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 779.170773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
16122024-12-21T00:47:23.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 529.262666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
16132024-12-21T00:47:23.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.013844743s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
16142024-12-21T00:47:23.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 673.140162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
16152024-12-21T00:47:24.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 1.177867194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
16162024-12-21T00:47:24.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 796.595038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
16172024-12-21T00:47:24.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 554.503697ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
16182024-12-21T00:47:24.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 1.161271405s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
16192024-12-21T00:47:24.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 1.397997077s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
16202024-12-21T00:47:24.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 1.138643899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
16212024-12-21T00:47:24.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 737.162312ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
16222024-12-21T00:47:24.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 853.261505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
16232024-12-21T00:47:24.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 1.375231987s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
16242024-12-21T00:47:24.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 1.395390928s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
16252024-12-21T00:47:24.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 815.85384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
16262024-12-21T00:47:24.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 1.352081736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
16272024-12-21T00:47:24.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 723.099527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
16282024-12-21T00:47:24.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 1.121814554s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
16292024-12-21T00:47:24.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 1.181024396s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
16302024-12-21T00:47:24.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 1.290604575s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
16312024-12-21T00:47:24.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 1.122677905s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
16322024-12-21T00:47:24.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 1.112149061s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
16332024-12-21T00:47:24.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 1.112308588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
16342024-12-21T00:47:24.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.129103914s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
16352024-12-21T00:47:25.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 919.895887ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
16362024-12-21T00:47:25.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 716.125818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
16372024-12-21T00:47:25.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 892.562809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
16382024-12-21T00:47:25.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.426042873s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
16392024-12-21T00:47:25.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 872.719288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
16402024-12-21T00:47:25.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 1.029629314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
16412024-12-21T00:47:25.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 1.030667439s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
16422024-12-21T00:47:25.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 846.071274ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
16432024-12-21T00:47:25.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 1.380136136s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
16442024-12-21T00:47:25.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 1.398012719s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
16452024-12-21T00:47:25.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 1.405386713s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
16462024-12-21T00:47:25.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 937.629659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
16472024-12-21T00:47:25.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 1.20162337s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
16482024-12-21T00:47:25.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 1.10205689s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
16492024-12-21T00:47:25.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 601.350577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
16502024-12-21T00:47:25.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 1.093581516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
16512024-12-21T00:47:26.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 599.175904ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
16522024-12-21T00:47:26.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 509.063968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
16532024-12-21T00:47:26.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 1.498610188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
16542024-12-21T00:47:26.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 502.547621ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
16552024-12-21T00:47:26.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 1.109526452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
16562024-12-21T00:47:26.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 657.680682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
16572024-12-21T00:47:26.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 647.981006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
16582024-12-21T00:47:26.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 711.483918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
16592024-12-21T00:47:26.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 1.150062289s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
16602024-12-21T00:47:26.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 1.3670356s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
16612024-12-21T00:47:26.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 1.289316811s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
16622024-12-21T00:47:26.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 1.051444232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
16632024-12-21T00:47:26.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.174711139s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
16642024-12-21T00:47:26.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 1.45588351s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
16652024-12-21T00:47:26.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 536.108625ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
16662024-12-21T00:47:26.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 808.297003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
16672024-12-21T00:47:26.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 1.436093343s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
16682024-12-21T00:47:26.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 1.021419937s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
16692024-12-21T00:47:27.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 803.015051ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
16702024-12-21T00:47:27.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 934.137533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
16712024-12-21T00:47:27.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 594.244282ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
16722024-12-21T00:47:27.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 778.919518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
16732024-12-21T00:47:27.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 703.400644ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
16742024-12-21T00:47:27.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 521.080524ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
16752024-12-21T00:47:27.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 837.538994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
16762024-12-21T00:47:27.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 692.030074ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
16772024-12-21T00:47:27.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 995.212186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
16782024-12-21T00:47:27.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 1.185450317s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
16792024-12-21T00:47:27.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 1.459541194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
16802024-12-21T00:47:27.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 984.636352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
16812024-12-21T00:47:27.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 1.448632841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
16822024-12-21T00:47:27.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 558.311383ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
16832024-12-21T00:47:27.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 1.31829342s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
16842024-12-21T00:47:27.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.122658841s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
16852024-12-21T00:47:27.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 556.282842ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
16862024-12-21T00:47:27.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 950.969266ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
16872024-12-21T00:47:27.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 1.203945832s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
16882024-12-21T00:47:27.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 801.73148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
16892024-12-21T00:47:27.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 754.522229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
16902024-12-21T00:47:27.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 1.394392329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
16912024-12-21T00:47:28.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 867.544771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
16922024-12-21T00:47:28.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 893.226619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
16932024-12-21T00:47:28.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 778.292658ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
16942024-12-21T00:47:28.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 1.044890355s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
16952024-12-21T00:47:28.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 1.381816865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
16962024-12-21T00:47:28.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 1.299521949s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
16972024-12-21T00:47:28.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 1.065819816s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
16982024-12-21T00:47:28.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 864.592258ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
16992024-12-21T00:47:28.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 1.32889264s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
17002024-12-21T00:47:28.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 1.011797977s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
17012024-12-21T00:47:28.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 933.993904ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
17022024-12-21T00:47:28.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 1.098325702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
17032024-12-21T00:47:28.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 708.708507ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
17042024-12-21T00:47:28.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.134332438s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
17052024-12-21T00:47:28.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 1.404273445s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
17062024-12-21T00:47:28.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.355176752s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
17072024-12-21T00:47:28.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 963.550927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
17082024-12-21T00:47:29.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 1.492020908s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
17092024-12-21T00:47:29.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 1.359228153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
17102024-12-21T00:47:29.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 1.138629794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
17112024-12-21T00:47:29.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 518.255997ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
17122024-12-21T00:47:29.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 886.646284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
17132024-12-21T00:47:29.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 1.252832548s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
17142024-12-21T00:47:29.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 1.189590699s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
17152024-12-21T00:47:29.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 1.49782165s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
17162024-12-21T00:47:29.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 1.311608535s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
17172024-12-21T00:47:29.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 1.245980661s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
17182024-12-21T00:47:29.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 1.496735772s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
17192024-12-21T00:47:29.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 709.9581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
17202024-12-21T00:47:29.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 807.412353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
17212024-12-21T00:47:29.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 787.573794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
17222024-12-21T00:47:29.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 711.138997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
17232024-12-21T00:47:29.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 1.439177993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
17242024-12-21T00:47:29.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 1.463718334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
17252024-12-21T00:47:30.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.019665316s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
17262024-12-21T00:47:30.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 1.269350234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
17272024-12-21T00:47:30.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 1.01621493s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
17282024-12-21T00:47:30.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.01938905s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
17292024-12-21T00:47:30.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 1.151111687s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
17302024-12-21T00:47:30.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 926.478797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
17312024-12-21T00:47:30.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 1.204017327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
17322024-12-21T00:47:30.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 1.259452393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
17332024-12-21T00:47:30.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 901.560003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
17342024-12-21T00:47:30.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 1.395493384s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
17352024-12-21T00:47:30.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 1.028077807s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
17362024-12-21T00:47:30.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 1.422140753s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
17372024-12-21T00:47:30.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 1.336655106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
17382024-12-21T00:47:30.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 1.221312264s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
17392024-12-21T00:47:30.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 586.188321ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
17402024-12-21T00:47:30.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 1.036390619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
17412024-12-21T00:47:31.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.202476088s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
17422024-12-21T00:47:31.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 654.373003ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
17432024-12-21T00:47:31.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 803.018317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
17442024-12-21T00:47:31.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.05637641s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
17452024-12-21T00:47:31.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 1.075039524s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
17462024-12-21T00:47:31.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 1.141715172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
17472024-12-21T00:47:31.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 1.029239357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
17482024-12-21T00:47:31.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 572.293738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
17492024-12-21T00:47:31.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 1.128713531s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
17502024-12-21T00:47:31.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 1.208267687s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
17512024-12-21T00:47:31.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 1.055415189s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
17522024-12-21T00:47:31.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 587.238566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
17532024-12-21T00:47:31.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 1.066578248s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
17542024-12-21T00:47:31.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 759.285749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
17552024-12-21T00:47:31.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 1.24888148s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
17562024-12-21T00:47:31.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 803.527688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
17572024-12-21T00:47:31.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 501.248342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
17582024-12-21T00:47:32.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 669.686725ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
17592024-12-21T00:47:32.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 936.903367ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
17602024-12-21T00:47:32.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 1.427414724s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
17612024-12-21T00:47:32.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 1.325972812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
17622024-12-21T00:47:32.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 931.253593ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
17632024-12-21T00:47:32.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 1.22882299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
17642024-12-21T00:47:32.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.116202237s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
17652024-12-21T00:47:32.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.226810144s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
17662024-12-21T00:47:32.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 1.107264583s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
17672024-12-21T00:47:32.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 1.462337936s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
17682024-12-21T00:47:32.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 1.350553349s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
17692024-12-21T00:47:32.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 644.584012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
17702024-12-21T00:47:32.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 1.427023734s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
17712024-12-21T00:47:32.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 883.360065ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
17722024-12-21T00:47:32.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 883.543531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
17732024-12-21T00:47:32.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 703.984299ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
17742024-12-21T00:47:32.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 959.928742ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
17752024-12-21T00:47:32.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 1.412500788s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
17762024-12-21T00:47:32.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 1.074906137s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
17772024-12-21T00:47:32.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 880.7082ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
17782024-12-21T00:47:33.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 1.380801059s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
17792024-12-21T00:47:33.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 1.039073724s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
17802024-12-21T00:47:33.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 838.682006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
17812024-12-21T00:47:33.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 1.220054028s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
17822024-12-21T00:47:33.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.274320068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
17832024-12-21T00:47:33.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 1.44317151s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
17842024-12-21T00:47:33.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9") failed: Property not found. retry in 1.197156449s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
17852024-12-21T00:47:33.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 693.710324ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
17862024-12-21T00:47:33.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 1.099636406s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
17872024-12-21T00:47:33.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 535.928056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
17882024-12-21T00:47:33.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 1.462905775s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
17892024-12-21T00:47:33.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.373094283s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
17902024-12-21T00:47:33.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 1.099008852s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
17912024-12-21T00:47:33.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 724.710808ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
17922024-12-21T00:47:33.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 1.445343254s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
17932024-12-21T00:47:33.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 1.334890988s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
17942024-12-21T00:47:33.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 1.246409509s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
17952024-12-21T00:47:34.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 646.424496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
17962024-12-21T00:47:34.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 1.303968003s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
17972024-12-21T00:47:34.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 1.445956324s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
17982024-12-21T00:47:34.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 1.223953281s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
17992024-12-21T00:47:34.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 508.084841ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
18002024-12-21T00:47:34.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 716.087929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
18012024-12-21T00:47:34.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 1.335772294s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
18022024-12-21T00:47:34.474ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34428
18032024-12-21T00:47:34.475ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 449 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34428 req_id = 157a9eca-bae8-43b9-9b1c-b9e2f99dbdb4 response_code = 200 uri = /baseboard
18042024-12-21T00:47:34.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 609.124646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
18052024-12-21T00:47:34.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 1.024798367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
18062024-12-21T00:47:34.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 1.183718724s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
18072024-12-21T00:47:34.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91") failed: Property not found. retry in 1.301986851s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
18082024-12-21T00:47:34.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.156838806s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
18092024-12-21T00:47:34.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 501.394514ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
18102024-12-21T00:47:34.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 847.085758ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
18112024-12-21T00:47:34.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 1.327895934s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
18122024-12-21T00:47:34.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 1.076780341s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
18132024-12-21T00:47:35.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 603.915934ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
18142024-12-21T00:47:35.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 870.759722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
18152024-12-21T00:47:35.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 1.237080479s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
18162024-12-21T00:47:35.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 1.1088943s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
18172024-12-21T00:47:35.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d") failed: Property not found. retry in 1.38071508s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
18182024-12-21T00:47:35.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 729.178552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
18192024-12-21T00:47:35.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 747.329932ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
18202024-12-21T00:47:35.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 632.650646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
18212024-12-21T00:47:35.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 867.025006ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
18222024-12-21T00:47:35.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec") failed: Property not found. retry in 1.467871923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
18232024-12-21T00:47:35.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90") failed: Property not found. retry in 1.284582155s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
18242024-12-21T00:47:35.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 834.298679ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
18252024-12-21T00:47:35.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f") failed: Property not found. retry in 1.457944567s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
18262024-12-21T00:47:35.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34") failed: Property not found. retry in 727.399326ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
18272024-12-21T00:47:35.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2") failed: Property not found. retry in 1.101997503s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
18282024-12-21T00:47:35.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0") failed: Property not found. retry in 1.089055968s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
18292024-12-21T00:47:35.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad") failed: Property not found. retry in 676.095004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
18302024-12-21T00:47:36.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5") failed: Property not found. retry in 1.200619012s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
18312024-12-21T00:47:36.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed") failed: Property not found. retry in 874.649759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
18322024-12-21T00:47:36.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1") failed: Property not found. retry in 990.369351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
18332024-12-21T00:47:36.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744") failed: Property not found. retry in 1.019957431s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
18342024-12-21T00:47:36.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3") failed: Property not found. retry in 1.390178952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
18352024-12-21T00:47:36.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761") failed: Property not found. retry in 1.136809121s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
18362024-12-21T00:47:36.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929") failed: Property not found. retry in 804.84305ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
18372024-12-21T00:47:36.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073") failed: Property not found. retry in 1.184967825s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
18382024-12-21T00:47:36.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c") failed: Property not found. retry in 1.035881226s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
18392024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_9df62edf-ae77-467e-8386-2594d7931d90
18402024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_483af31e-ed94-4518-b616-4ec2dc232929
18412024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_176c56ae-3f0a-4c04-a40a-300d58486e34
18422024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_af13cdd9-a8ea-4207-84fe-15d8dba9e8a2
18432024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_db6aef45-e599-452c-8c04-40a5c3a5879c
18442024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_3347806f-91f1-4759-93a3-0ebbc51785b3
18452024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_9d992651-fc2d-4371-a1df-244ce9f989f9
18462024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_74b7cf96-dd99-473a-b00e-26ee605023ad
18472024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_3b31669e-ed79-4765-9f80-c063c63fac2d
18482024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_b1b2f597-e35b-4ff6-b1fd-1d9d3c81c7ec
18492024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_3bcf1dbd-0e42-4153-a0c3-1510c66bb744
18502024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_e3773db0-2640-4087-964f-b0d35e1f81ed
18512024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_6d84d8d8-9b64-424a-b5f7-3073ed8bf761
18522024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_53889989-d09a-4ae2-a9ba-7db0bf231073
18532024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_b34affeb-a4cc-473c-8fb4-381bb3b4da91
18542024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_c215f370-9263-4008-b5bd-586f117238f5
18552024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_8184d1b0-c850-4a68-9ec0-f0dfc1290ad1
18562024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_f897b3b6-8590-4a9b-9f19-0699730e2ab0
18572024-12-21T00:47:37.683ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_4dd3d39e-1dd3-4070-9fa1-159571d59e2f
18582024-12-21T00:47:37.687ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18592024-12-21T00:47:37.696ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18602024-12-21T00:47:37.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33334490 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50504 req_id = e179836a-163f-411a-81ee-b9712169ee84 response_code = 204 uri = /omicron-zones
18612024-12-21T00:47:37.732ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
18622024-12-21T00:47:37.938ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18632024-12-21T00:47:37.945ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
18642024-12-21T00:47:37.986ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
18652024-12-21T00:47:40.395ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18662024-12-21T00:47:40.416ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
18672024-12-21T00:47:40.500ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18682024-12-21T00:47:40.651ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18692024-12-21T00:47:40.836ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18702024-12-21T00:47:40.941ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18712024-12-21T00:47:41.078ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18722024-12-21T00:47:41.246ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18732024-12-21T00:47:41.422ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
18742024-12-21T00:47:41.630ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18752024-12-21T00:47:41.993ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18762024-12-21T00:47:42.424ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
18772024-12-21T00:47:42.438ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/nexus.rs:527 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
18782024-12-21T00:47:42.489ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18792024-12-21T00:47:43.026ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 62.677858986s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
18802024-12-21T00:47:43.118ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18812024-12-21T00:47:43.397ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/nexus.rs:527 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
18822024-12-21T00:47:43.427ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bf099da7-dcc9-4db5-96e6-2fb4244a4a3c) file = sled-agent/src/probe_manager.rs:231 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
18832024-12-21T00:47:43.449ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b4a43785-b93e-4203-8bbb-be9c4e6bfa2c/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18842024-12-21T00:47:44.568ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "448342d0-8c12-4cb8-9556-657b5a5a51f7", "content-length": "113", "date": "Sat, 21 Dec 2024 00:47:44 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "448342d0-8c12-4cb8-9556-657b5a5a51f7" } file = sled-agent/src/rack_setup/service.rs:1078
18852024-12-21T00:47:48.855ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
18862024-12-21T00:47:50.066ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5f2c7ada-06ca-4a4c-935e-2cc1aebee57e", "content-length": "173", "date": "Sat, 21 Dec 2024 00:47:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b4a43785-b93e-4203-8bbb-be9c4e6bfa2c\"", request_id: "5f2c7ada-06ca-4a4c-935e-2cc1aebee57e" } file = sled-agent/src/rack_setup/service.rs:1078
18872024-12-21T00:47:54.270ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4363cd1b-338b-4ff3-8ca5-03abc1ede7c9", "content-length": "173", "date": "Sat, 21 Dec 2024 00:47:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b4a43785-b93e-4203-8bbb-be9c4e6bfa2c\"", request_id: "4363cd1b-338b-4ff3-8ca5-03abc1ede7c9" } file = sled-agent/src/rack_setup/service.rs:1078
18882024-12-21T00:47:55.219ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "95a1cfc4-50ca-4281-bd8a-86d108495c22", "content-length": "173", "date": "Sat, 21 Dec 2024 00:47:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b4a43785-b93e-4203-8bbb-be9c4e6bfa2c\"", request_id: "95a1cfc4-50ca-4281-bd8a-86d108495c22" } file = sled-agent/src/rack_setup/service.rs:1078
18892024-12-21T00:47:55.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55568
18902024-12-21T00:47:55.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3406 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55568 req_id = c5ea6af5-8c09-47cc-975e-cdf08ab500c8 response_code = 200 uri = /vpc-routes
18912024-12-21T00:47:55.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48481
18922024-12-21T00:47:55.800ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18932024-12-21T00:47:55.800ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18942024-12-21T00:47:55.801ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:177
18952024-12-21T00:47:55.809ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:177
18962024-12-21T00:47:55.825ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18972024-12-21T00:47:55.825ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_590ffd4f-3c08-4aaa-9320-324eceef269f
18982024-12-21T00:47:55.857ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18992024-12-21T00:47:55.857ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c679f342-f128-44a0-ab2d-f59379b9850c
19002024-12-21T00:47:55.887ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19012024-12-21T00:47:55.887ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_73f3806f-f01a-4ed9-9018-33c83b997a06
19022024-12-21T00:47:55.916ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19032024-12-21T00:47:55.916ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b745a-6af3-41e8-a39a-73607778df7f
19042024-12-21T00:47:55.931ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
19052024-12-21T00:47:55.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 657 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55568 req_id = caaacbd4-00d5-4f1f-adab-6e9ee3fad341 response_code = 204 uri = /eip-gateways
19062024-12-21T00:47:55.944ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19072024-12-21T00:47:55.944ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a
19082024-12-21T00:47:55.972ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19092024-12-21T00:47:55.972ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a
19102024-12-21T00:47:55.999ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19112024-12-21T00:47:55.999ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99
19122024-12-21T00:47:56.022ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19132024-12-21T00:47:56.022ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb
19142024-12-21T00:47:56.045ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19152024-12-21T00:47:56.045ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b
19162024-12-21T00:47:56.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48481 req_id = 0e6d0a8a-1bae-470b-a1c6-c6f40303e7c8 response_code = 200 uri = /inventory
19172024-12-21T00:47:56.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47325
19182024-12-21T00:47:56.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 912 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47325 req_id = f124fd55-540a-495b-8147-e14319847f44 response_code = 200 uri = /v2p
19192024-12-21T00:47:56.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55568 req_id = 4e2a0959-27cf-4f30-92f9-92fb996a2257 response_code = 204 uri = /vpc-routes
19202024-12-21T00:47:56.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63985
19212024-12-21T00:47:56.769ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19222024-12-21T00:47:56.769ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19232024-12-21T00:47:56.769ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:177
19242024-12-21T00:47:56.769ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:177
19252024-12-21T00:47:56.782ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19262024-12-21T00:47:56.782ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_590ffd4f-3c08-4aaa-9320-324eceef269f
19272024-12-21T00:47:56.811ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19282024-12-21T00:47:56.811ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c679f342-f128-44a0-ab2d-f59379b9850c
19292024-12-21T00:47:56.845ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19302024-12-21T00:47:56.845ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_73f3806f-f01a-4ed9-9018-33c83b997a06
19312024-12-21T00:47:56.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63556
19322024-12-21T00:47:56.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63556 req_id = 5c794466-be1f-4990-aa69-664193427fbd response_code = 200 uri = /vpc-routes
19332024-12-21T00:47:56.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49725
19342024-12-21T00:47:56.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49725 req_id = 2b7a7f81-99b8-49df-aad7-6cbfe1a9d15b response_code = 200 uri = /vpc-routes
19352024-12-21T00:47:56.876ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19362024-12-21T00:47:56.876ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b745a-6af3-41e8-a39a-73607778df7f
19372024-12-21T00:47:56.907ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19382024-12-21T00:47:56.907ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a
19392024-12-21T00:47:56.942ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19402024-12-21T00:47:56.943ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a
19412024-12-21T00:47:56.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49712
19422024-12-21T00:47:56.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
19432024-12-21T00:47:56.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49725 req_id = ec80d1b8-f92a-41a7-bfb0-ec92dad41cbc response_code = 204 uri = /eip-gateways
19442024-12-21T00:47:56.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
19452024-12-21T00:47:56.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63556 req_id = 0f2aa49e-d68b-45c1-802a-45c3522dad2e response_code = 204 uri = /eip-gateways
19462024-12-21T00:47:56.961ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19472024-12-21T00:47:56.961ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19482024-12-21T00:47:56.961ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:177
19492024-12-21T00:47:56.966ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:177
19502024-12-21T00:47:56.975ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19512024-12-21T00:47:56.975ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99
19522024-12-21T00:47:56.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33405
19532024-12-21T00:47:56.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33405 req_id = 578a82cb-2794-452f-922e-ca17331e4a2e response_code = 200 uri = /v2p
19542024-12-21T00:47:56.993ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19552024-12-21T00:47:56.993ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_590ffd4f-3c08-4aaa-9320-324eceef269f
19562024-12-21T00:47:57.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33757
19572024-12-21T00:47:57.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19582024-12-21T00:47:57.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19592024-12-21T00:47:57.022ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:177
19602024-12-21T00:47:57.023ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19612024-12-21T00:47:57.023ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c679f342-f128-44a0-ab2d-f59379b9850c
19622024-12-21T00:47:57.028ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:177
19632024-12-21T00:47:57.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58367
19642024-12-21T00:47:57.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58367 req_id = 3187add6-d7ee-447f-9b57-edf32e329c98 response_code = 200 uri = /v2p
19652024-12-21T00:47:57.043ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19662024-12-21T00:47:57.043ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb
19672024-12-21T00:47:57.063ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19682024-12-21T00:47:57.063ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_590ffd4f-3c08-4aaa-9320-324eceef269f
19692024-12-21T00:47:57.090ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19702024-12-21T00:47:57.090ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_73f3806f-f01a-4ed9-9018-33c83b997a06
19712024-12-21T00:47:57.108ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19722024-12-21T00:47:57.108ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b
19732024-12-21T00:47:57.128ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19742024-12-21T00:47:57.129ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c679f342-f128-44a0-ab2d-f59379b9850c
19752024-12-21T00:47:57.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63985 req_id = 0f7e8bc1-e056-4ce2-8bc9-faacb3a908f7 response_code = 200 uri = /inventory
19762024-12-21T00:47:57.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49725 req_id = 10a6489c-99bc-4135-90f0-11a04d986e9c response_code = 204 uri = /vpc-routes
19772024-12-21T00:47:57.145ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19782024-12-21T00:47:57.145ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b745a-6af3-41e8-a39a-73607778df7f
19792024-12-21T00:47:57.164ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19802024-12-21T00:47:57.164ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_73f3806f-f01a-4ed9-9018-33c83b997a06
19812024-12-21T00:47:57.172ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
19822024-12-21T00:47:57.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5092 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63556 req_id = 5d98dfc8-4550-4e90-ac36-07e8feeaee96 response_code = 204 uri = /vpc-routes
19832024-12-21T00:47:57.186ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19842024-12-21T00:47:57.186ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a
19852024-12-21T00:47:57.206ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19862024-12-21T00:47:57.206ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b745a-6af3-41e8-a39a-73607778df7f
19872024-12-21T00:47:57.224ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19882024-12-21T00:47:57.224ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a
19892024-12-21T00:47:57.255ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19902024-12-21T00:47:57.255ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99
19912024-12-21T00:47:57.270ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19922024-12-21T00:47:57.270ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a
19932024-12-21T00:47:57.292ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19942024-12-21T00:47:57.292ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb
19952024-12-21T00:47:57.307ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19962024-12-21T00:47:57.307ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a
19972024-12-21T00:47:57.326ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19982024-12-21T00:47:57.326ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b
19992024-12-21T00:47:57.345ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20002024-12-21T00:47:57.345ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99
20012024-12-21T00:47:57.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 399993 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49712 req_id = fb3e4053-b673-47f3-8cb9-ec69dee56acd response_code = 200 uri = /inventory
20022024-12-21T00:47:57.370ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20032024-12-21T00:47:57.370ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb
20042024-12-21T00:47:57.399ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20052024-12-21T00:47:57.399ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b
20062024-12-21T00:47:57.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 394808 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33757 req_id = 1df37c07-bb1f-4183-8f10-7a48790312c4 response_code = 200 uri = /inventory
20072024-12-21T00:47:58.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38976
20082024-12-21T00:47:58.876ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6887e424-c467-4dc7-a8b3-00acc28971d2, kind: Service { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 }, name: Name("external-dns-3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e8e123f1-5057-4c14-a500-5a66ca1807d8, kind: Service { id: 9df62edf-ae77-467e-8386-2594d7931d90 }, name: Name("external-dns-9df62edf-ae77-467e-8386-2594d7931d90"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 190])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104166fa-0281-40e0-a912-f30ba4e7f1c0, kind: Service { id: 3b31669e-ed79-4765-9f80-c063c63fac2d }, name: Name("nexus-3b31669e-ed79-4765-9f80-c063c63fac2d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 150b0c67-783e-4dab-936e-88cb1fe1cda3, kind: Service { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 }, name: Name("nexus-176c56ae-3f0a-4c04-a40a-300d58486e34"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c44fd269-5de0-4bbf-8a47-97be7cf8ce40, kind: Service { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 }, name: Name("nexus-af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20092024-12-21T00:47:58.876ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20102024-12-21T00:47:58.876ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20112024-12-21T00:47:58.876ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20122024-12-21T00:47:58.876ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20132024-12-21T00:47:58.876ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20142024-12-21T00:47:58.876ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20152024-12-21T00:47:58.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1096 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38976 req_id = 7460ca8e-4102-4b41-9b6d-f0b26c48ee4f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20162024-12-21T00:47:58.877ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
20172024-12-21T00:47:58.881ZINFOSledAgent (RSS): Writing ledger to /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
20182024-12-21T00:47:58.882ZINFOSledAgent (RSS): Writing ledger to /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
20192024-12-21T00:47:59.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64863
20202024-12-21T00:47:59.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20212024-12-21T00:47:59.192ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20222024-12-21T00:47:59.192ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:177
20232024-12-21T00:47:59.193ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:177
20242024-12-21T00:47:59.205ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20252024-12-21T00:47:59.205ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_590ffd4f-3c08-4aaa-9320-324eceef269f
20262024-12-21T00:47:59.235ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20272024-12-21T00:47:59.235ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c679f342-f128-44a0-ab2d-f59379b9850c
20282024-12-21T00:47:59.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20292024-12-21T00:47:59.267ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_73f3806f-f01a-4ed9-9018-33c83b997a06
20302024-12-21T00:47:59.297ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20312024-12-21T00:47:59.297ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b745a-6af3-41e8-a39a-73607778df7f
20322024-12-21T00:47:59.324ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20332024-12-21T00:47:59.324ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a
20342024-12-21T00:47:59.349ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20352024-12-21T00:47:59.350ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a
20362024-12-21T00:47:59.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55559
20372024-12-21T00:47:59.361ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6887e424-c467-4dc7-a8b3-00acc28971d2, kind: Service { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 }, name: Name("external-dns-3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e8e123f1-5057-4c14-a500-5a66ca1807d8, kind: Service { id: 9df62edf-ae77-467e-8386-2594d7931d90 }, name: Name("external-dns-9df62edf-ae77-467e-8386-2594d7931d90"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 190])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104166fa-0281-40e0-a912-f30ba4e7f1c0, kind: Service { id: 3b31669e-ed79-4765-9f80-c063c63fac2d }, name: Name("nexus-3b31669e-ed79-4765-9f80-c063c63fac2d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 150b0c67-783e-4dab-936e-88cb1fe1cda3, kind: Service { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 }, name: Name("nexus-176c56ae-3f0a-4c04-a40a-300d58486e34"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c44fd269-5de0-4bbf-8a47-97be7cf8ce40, kind: Service { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 }, name: Name("nexus-af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20382024-12-21T00:47:59.361ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20392024-12-21T00:47:59.361ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20402024-12-21T00:47:59.361ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20412024-12-21T00:47:59.361ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20422024-12-21T00:47:59.361ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20432024-12-21T00:47:59.361ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20442024-12-21T00:47:59.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 400 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55559 req_id = 159ee28b-cbf1-4af0-a8cb-b0e22b015175 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20452024-12-21T00:47:59.375ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20462024-12-21T00:47:59.375ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99
20472024-12-21T00:47:59.405ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20482024-12-21T00:47:59.405ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb
20492024-12-21T00:47:59.429ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20502024-12-21T00:47:59.429ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b
20512024-12-21T00:47:59.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252036 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64863 req_id = e10fda0d-e6ad-4706-a16a-70d48a7a3892 response_code = 200 uri = /inventory
20522024-12-21T00:47:59.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51799
20532024-12-21T00:47:59.779ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6887e424-c467-4dc7-a8b3-00acc28971d2, kind: Service { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 }, name: Name("external-dns-3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e8e123f1-5057-4c14-a500-5a66ca1807d8, kind: Service { id: 9df62edf-ae77-467e-8386-2594d7931d90 }, name: Name("external-dns-9df62edf-ae77-467e-8386-2594d7931d90"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 190])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104166fa-0281-40e0-a912-f30ba4e7f1c0, kind: Service { id: 3b31669e-ed79-4765-9f80-c063c63fac2d }, name: Name("nexus-3b31669e-ed79-4765-9f80-c063c63fac2d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 150b0c67-783e-4dab-936e-88cb1fe1cda3, kind: Service { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 }, name: Name("nexus-176c56ae-3f0a-4c04-a40a-300d58486e34"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c44fd269-5de0-4bbf-8a47-97be7cf8ce40, kind: Service { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 }, name: Name("nexus-af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20542024-12-21T00:47:59.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20552024-12-21T00:47:59.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20562024-12-21T00:47:59.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20572024-12-21T00:47:59.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20582024-12-21T00:47:59.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20592024-12-21T00:47:59.779ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20602024-12-21T00:47:59.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51799 req_id = 5b3aec0b-4432-4de1-ab11-c17ca459e522 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20612024-12-21T00:48:00.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56147
20622024-12-21T00:48:00.588ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6887e424-c467-4dc7-a8b3-00acc28971d2, kind: Service { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 }, name: Name("external-dns-3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e8e123f1-5057-4c14-a500-5a66ca1807d8, kind: Service { id: 9df62edf-ae77-467e-8386-2594d7931d90 }, name: Name("external-dns-9df62edf-ae77-467e-8386-2594d7931d90"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 190])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104166fa-0281-40e0-a912-f30ba4e7f1c0, kind: Service { id: 3b31669e-ed79-4765-9f80-c063c63fac2d }, name: Name("nexus-3b31669e-ed79-4765-9f80-c063c63fac2d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 150b0c67-783e-4dab-936e-88cb1fe1cda3, kind: Service { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 }, name: Name("nexus-176c56ae-3f0a-4c04-a40a-300d58486e34"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c44fd269-5de0-4bbf-8a47-97be7cf8ce40, kind: Service { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 }, name: Name("nexus-af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20632024-12-21T00:48:00.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20642024-12-21T00:48:00.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20652024-12-21T00:48:00.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20662024-12-21T00:48:00.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20672024-12-21T00:48:00.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20682024-12-21T00:48:00.588ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20692024-12-21T00:48:00.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56147 req_id = fa0a97e5-340c-45c3-83cf-d3e3c970ede6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20702024-12-21T00:48:04.515ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62418
20712024-12-21T00:48:04.516ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62418 req_id = 2deb864c-0717-41fd-b54e-e8c91493d186 response_code = 200 uri = /baseboard
20722024-12-21T00:48:06.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54606
20732024-12-21T00:48:06.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54606 req_id = f702e600-8462-4250-a678-8f62ad2eeb55 response_code = 200 uri = /vpc-routes
20742024-12-21T00:48:06.848ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
20752024-12-21T00:48:06.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54606 req_id = cc8df20a-cdf0-4aaa-a004-437546fc8c6e response_code = 204 uri = /eip-gateways
20762024-12-21T00:48:06.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54606 req_id = 9b9fc904-cbe5-4009-98b0-509ff42f768f response_code = 204 uri = /vpc-routes
20772024-12-21T00:48:25.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50798
20782024-12-21T00:48:25.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50798 req_id = 8c43164c-dd7f-4c57-91e6-0ef318d99cec response_code = 200 uri = /vpc-routes
20792024-12-21T00:48:25.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
20802024-12-21T00:48:25.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50798 req_id = fffabc4c-e454-4a1d-8da2-a3c22f6b5cfc response_code = 204 uri = /eip-gateways
20812024-12-21T00:48:25.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50798 req_id = 22bbede1-7bf6-4e89-9588-fe968b048e2d response_code = 204 uri = /vpc-routes
20822024-12-21T00:48:25.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45443
20832024-12-21T00:48:25.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45443 req_id = 8d5e93e1-0f73-4d0b-9499-f7591907c3b7 response_code = 200 uri = /v2p
20842024-12-21T00:48:25.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45364
20852024-12-21T00:48:25.936ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20862024-12-21T00:48:26.006ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20872024-12-21T00:48:26.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132366 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45364 req_id = 9b3bb32c-cdd6-4f28-9a99-bdbe4441a728 response_code = 204 uri = /switch-ports
20882024-12-21T00:48:26.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6051 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45364 req_id = a6ca1920-440c-4fc4-8186-fc7e31497818 response_code = 200 uri = /network-bootstore-config
20892024-12-21T00:48:26.127ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
20902024-12-21T00:48:26.127ZINFOSledAgent (bootstore): Writing ledger to /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20912024-12-21T00:48:26.128ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20922024-12-21T00:48:26.129ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
20932024-12-21T00:48:26.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2693 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45364 req_id = 5eef5275-126f-438c-bfea-ec3c1be48a4e response_code = 204 uri = /network-bootstore-config
20942024-12-21T00:48:26.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36488
20952024-12-21T00:48:26.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36488 req_id = 8f6fb35c-75dd-4318-ba4e-e32566455833 response_code = 200 uri = /vpc-routes
20962024-12-21T00:48:26.700ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
20972024-12-21T00:48:26.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36488 req_id = dabd1931-c7b1-4207-bd1c-8a932a95dcc0 response_code = 204 uri = /eip-gateways
20982024-12-21T00:48:26.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36488 req_id = 2fc1d893-d3f6-42d0-a0f1-25b96f640b7f response_code = 204 uri = /vpc-routes
20992024-12-21T00:48:26.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59935
21002024-12-21T00:48:26.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59935 req_id = 2dcd0cc4-dbd3-417a-9030-3c1a68d23649 response_code = 200 uri = /v2p
21012024-12-21T00:48:26.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56799
21022024-12-21T00:48:26.946ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21032024-12-21T00:48:26.983ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21042024-12-21T00:48:27.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97159 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56799 req_id = 08c29a4a-ffc0-4ef5-b734-4a448c87c5e2 response_code = 204 uri = /switch-ports
21052024-12-21T00:48:27.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62501
21062024-12-21T00:48:27.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62501 req_id = f4cd3710-47f2-4010-837c-5e039a221cb8 response_code = 200 uri = /vpc-routes
21072024-12-21T00:48:27.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56799 req_id = 9e500726-70ad-4ff6-a51f-7fc71e7bcd10 response_code = 200 uri = /network-bootstore-config
21082024-12-21T00:48:27.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43358
21092024-12-21T00:48:27.055ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21102024-12-21T00:48:27.094ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21112024-12-21T00:48:27.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96929 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43358 req_id = c4b19072-36b8-4214-ac05-5455689351ba response_code = 204 uri = /switch-ports
21122024-12-21T00:48:27.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62370
21132024-12-21T00:48:27.153ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
21142024-12-21T00:48:27.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62501 req_id = 488ff979-cd14-4ccb-8c65-0e564113b463 response_code = 204 uri = /eip-gateways
21152024-12-21T00:48:27.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43358 req_id = 507befe8-5778-4bff-9ff5-7d7b6ce87a6b response_code = 200 uri = /network-bootstore-config
21162024-12-21T00:48:27.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62370 req_id = bebdcf60-ff45-427b-8f23-e14cb42cd82c response_code = 200 uri = /v2p
21172024-12-21T00:48:27.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62501 req_id = 003823ac-6b3e-4614-8411-912f15043a51 response_code = 204 uri = /vpc-routes
21182024-12-21T00:48:34.561ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50838
21192024-12-21T00:48:34.561ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50838 req_id = a2fa008c-be2a-46d3-b2a4-b7f6c1c4bdcc response_code = 200 uri = /baseboard
21202024-12-21T00:48:51.917ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
21212024-12-21T00:48:55.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40962
21222024-12-21T00:48:55.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40962 req_id = 8563d591-12a1-4801-95da-a4bb93a5fc3a response_code = 200 uri = /vpc-routes
21232024-12-21T00:48:55.784ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
21242024-12-21T00:48:55.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40962 req_id = b386dfc6-449b-4aa4-9a8c-f23f4c10e362 response_code = 204 uri = /eip-gateways
21252024-12-21T00:48:55.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40962 req_id = 702dd435-8837-4b76-a0da-803e31474633 response_code = 204 uri = /vpc-routes
21262024-12-21T00:48:55.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63072
21272024-12-21T00:48:55.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63072 req_id = 59cfc03a-ba64-436c-b326-c66b1f74f1f9 response_code = 200 uri = /v2p
21282024-12-21T00:48:55.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52604
21292024-12-21T00:48:55.887ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21302024-12-21T00:48:55.925ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21312024-12-21T00:48:55.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88951 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52604 req_id = 4693a5ac-d509-4e6c-b28d-b139b812259a response_code = 204 uri = /switch-ports
21322024-12-21T00:48:55.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52604 req_id = e7776415-8385-4c24-9540-77de5c107ca4 response_code = 200 uri = /network-bootstore-config
21332024-12-21T00:48:56.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56590
21342024-12-21T00:48:56.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56590 req_id = a0ad3310-e5ac-4540-8953-774e7c960975 response_code = 200 uri = /vpc-routes
21352024-12-21T00:48:56.753ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
21362024-12-21T00:48:56.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56590 req_id = 383bddef-b9f0-4cd5-8c31-3bd2b507db38 response_code = 204 uri = /eip-gateways
21372024-12-21T00:48:56.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60731
21382024-12-21T00:48:56.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60731 req_id = 20772e0c-f1d7-443f-8528-02ab1faa34a2 response_code = 200 uri = /v2p
21392024-12-21T00:48:56.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56590 req_id = 27265776-008d-48e3-87ee-277f5c305da0 response_code = 204 uri = /vpc-routes
21402024-12-21T00:48:56.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50761
21412024-12-21T00:48:56.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50761 req_id = e91f5b08-e816-4dc2-844f-29f219e8b355 response_code = 200 uri = /vpc-routes
21422024-12-21T00:48:56.980ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
21432024-12-21T00:48:56.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50761 req_id = 2f5e2f1d-03c5-43d3-9a98-fecfcd66aee9 response_code = 204 uri = /eip-gateways
21442024-12-21T00:48:56.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50761 req_id = 5b8423c0-af23-41c7-8c2b-278d0f110c7a response_code = 204 uri = /vpc-routes
21452024-12-21T00:48:57.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62768
21462024-12-21T00:48:57.046ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21472024-12-21T00:48:57.084ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21482024-12-21T00:48:57.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94507 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62768 req_id = c93c6c88-0bec-429e-88ab-b12ecf0884d9 response_code = 204 uri = /switch-ports
21492024-12-21T00:48:57.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55518
21502024-12-21T00:48:57.141ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21512024-12-21T00:48:57.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62768 req_id = d7e057d2-4f36-40ac-acef-d2e46e919b27 response_code = 200 uri = /network-bootstore-config
21522024-12-21T00:48:57.181ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21532024-12-21T00:48:57.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63948
21542024-12-21T00:48:57.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63948 req_id = 2313e882-d8a6-4a9a-9bc2-b5434b8990cb response_code = 200 uri = /v2p
21552024-12-21T00:48:57.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91072 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55518 req_id = 54751383-a559-4523-9675-a0e635956cf2 response_code = 204 uri = /switch-ports
21562024-12-21T00:48:57.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55518 req_id = 568f4e0e-2062-4d57-ae15-ad366009dffc response_code = 200 uri = /network-bootstore-config
21572024-12-21T00:49:04.594ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40382
21582024-12-21T00:49:04.594ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40382 req_id = e7f8da71-02da-402b-a022-b3dea7f016b7 response_code = 200 uri = /baseboard
21592024-12-21T00:49:25.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64256
21602024-12-21T00:49:25.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64256 req_id = cf233c52-3989-4705-aa51-7f63064626f6 response_code = 200 uri = /vpc-routes
21612024-12-21T00:49:25.683ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
21622024-12-21T00:49:25.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64256 req_id = e7ec5de2-a9a3-4ae7-8d3a-4c63ad537b5c response_code = 204 uri = /eip-gateways
21632024-12-21T00:49:25.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64256 req_id = 466aa8f3-3238-4706-b204-6f0bf86bd378 response_code = 204 uri = /vpc-routes
21642024-12-21T00:49:25.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35653
21652024-12-21T00:49:25.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35653 req_id = 1778edb7-dc45-4de8-8076-fc61855a1c42 response_code = 200 uri = /v2p
21662024-12-21T00:49:25.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58154
21672024-12-21T00:49:25.835ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21682024-12-21T00:49:25.874ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21692024-12-21T00:49:25.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91361 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58154 req_id = 4fbe7535-08bf-4eaf-aaea-c23e4c81497e response_code = 204 uri = /switch-ports
21702024-12-21T00:49:25.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58154 req_id = 2d13b09f-be0c-431f-be76-6fbeeed0c93d response_code = 200 uri = /network-bootstore-config
21712024-12-21T00:49:26.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39265
21722024-12-21T00:49:26.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39265 req_id = ad0584ac-39ab-4f66-bd2f-330c3c84f51d response_code = 200 uri = /vpc-routes
21732024-12-21T00:49:26.774ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
21742024-12-21T00:49:26.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39265 req_id = 3f7e9c6d-7930-4beb-b5e0-463172d6eb94 response_code = 204 uri = /eip-gateways
21752024-12-21T00:49:26.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39265 req_id = f4df3756-1f9e-4776-8809-318f9fa6334d response_code = 204 uri = /vpc-routes
21762024-12-21T00:49:26.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56501
21772024-12-21T00:49:26.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56501 req_id = 5a72410a-7b6d-4a61-8770-e14b409ce4d6 response_code = 200 uri = /vpc-routes
21782024-12-21T00:49:26.840ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
21792024-12-21T00:49:26.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56501 req_id = 1eb00193-e48e-46c2-9f40-903fdebd6fb2 response_code = 204 uri = /eip-gateways
21802024-12-21T00:49:26.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56501 req_id = 96d601ae-d356-4fd5-a8d0-7a77f9fdc35c response_code = 204 uri = /vpc-routes
21812024-12-21T00:49:26.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45235
21822024-12-21T00:49:26.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45235 req_id = 6d67e7f9-0eef-4d73-8f89-1a222f57db80 response_code = 200 uri = /v2p
21832024-12-21T00:49:26.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50337
21842024-12-21T00:49:26.933ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21852024-12-21T00:49:26.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21862024-12-21T00:49:27.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100088 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50337 req_id = 8fb665eb-874a-4571-abbc-34028ca4e90b response_code = 204 uri = /switch-ports
21872024-12-21T00:49:27.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44089
21882024-12-21T00:49:27.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62900
21892024-12-21T00:49:27.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44089 req_id = 03a3edf9-b9da-4885-92b6-ade425785b73 response_code = 200 uri = /v2p
21902024-12-21T00:49:27.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50337 req_id = 4fc80010-b3e5-40ad-a3ea-77bc5ff8f7fc response_code = 200 uri = /network-bootstore-config
21912024-12-21T00:49:27.034ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21922024-12-21T00:49:27.070ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21932024-12-21T00:49:27.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88326 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62900 req_id = 74969786-d499-45be-87be-fd78406e3bc4 response_code = 204 uri = /switch-ports
21942024-12-21T00:49:27.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62900 req_id = 889e41a0-d444-4408-8a11-f17907dbc092 response_code = 200 uri = /network-bootstore-config
21952024-12-21T00:49:29.733ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:63341 remote_addr = [fd00:1122:3344:101::d]:54850 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
21962024-12-21T00:49:29.767ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31736 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = fc1bc023-7b2c-4686-be28-b57877a4707d response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
21972024-12-21T00:49:34.628ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50797
21982024-12-21T00:49:34.628ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50797 req_id = bf004e1f-d542-40db-b21c-258b3350b861 response_code = 200 uri = /baseboard
21992024-12-21T00:49:55.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36609
22002024-12-21T00:49:55.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36609 req_id = 454dc460-7f17-4c5e-98f7-413e07899a9c response_code = 200 uri = /vpc-routes
22012024-12-21T00:49:55.969ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
22022024-12-21T00:49:55.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36609 req_id = 0d321e47-a623-4acd-918e-d54d153cf326 response_code = 204 uri = /eip-gateways
22032024-12-21T00:49:55.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36609 req_id = d00e38a7-ddfe-444e-b68e-43f44f920b4a response_code = 204 uri = /vpc-routes
22042024-12-21T00:49:56.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40888
22052024-12-21T00:49:56.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40888 req_id = e4810833-e90c-4ca0-bda5-904cec89e1df response_code = 200 uri = /v2p
22062024-12-21T00:49:56.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47784
22072024-12-21T00:49:56.241ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22082024-12-21T00:49:56.278ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22092024-12-21T00:49:56.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90505 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47784 req_id = 1470837a-b823-442b-ae90-8c71fd7f91b4 response_code = 204 uri = /switch-ports
22102024-12-21T00:49:56.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47784 req_id = b403dba0-51e8-411f-90e9-7115b87ab213 response_code = 200 uri = /network-bootstore-config
22112024-12-21T00:49:56.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62595
22122024-12-21T00:49:56.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62595 req_id = f26e3840-928b-40c1-b5a8-ddaf37e77d56 response_code = 200 uri = /vpc-routes
22132024-12-21T00:49:56.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33289
22142024-12-21T00:49:56.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33289 req_id = 607b661f-e85c-43ce-9c54-994fbac09e98 response_code = 200 uri = /vpc-routes
22152024-12-21T00:49:56.889ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
22162024-12-21T00:49:56.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62595 req_id = 9da1f05b-d05f-4eb6-89dc-efcdc62fb606 response_code = 204 uri = /eip-gateways
22172024-12-21T00:49:56.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62595 req_id = f7b87cca-e9fc-4f87-85ca-a099d442d401 response_code = 204 uri = /vpc-routes
22182024-12-21T00:49:56.925ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
22192024-12-21T00:49:56.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33289 req_id = 24358ba0-95e2-48ed-b248-abec12b64863 response_code = 204 uri = /eip-gateways
22202024-12-21T00:49:56.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33289 req_id = b8959d77-bbf2-4dd5-9264-4179d835e618 response_code = 204 uri = /vpc-routes
22212024-12-21T00:49:57.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60506
22222024-12-21T00:49:57.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60506 req_id = 6b7c0d3e-8ef7-4a9b-a5d2-90351045a7e5 response_code = 200 uri = /v2p
22232024-12-21T00:49:57.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65301
22242024-12-21T00:49:57.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65301 req_id = 5e8dca4d-ae98-43d2-98fe-a8b03f8f6744 response_code = 200 uri = /v2p
22252024-12-21T00:49:57.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40682
22262024-12-21T00:49:57.135ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22272024-12-21T00:49:57.172ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22282024-12-21T00:49:57.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40682 req_id = 15262ae4-c7fe-4f81-92aa-f82e11fed06f response_code = 204 uri = /switch-ports
22292024-12-21T00:49:57.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41782
22302024-12-21T00:49:57.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40682 req_id = 4ecfc40e-9b19-4dfe-b78c-95f6f1e6639c response_code = 200 uri = /network-bootstore-config
22312024-12-21T00:49:57.226ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22322024-12-21T00:49:57.263ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22332024-12-21T00:49:57.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92017 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41782 req_id = a11baa36-1f4b-42b4-8475-57660945163c response_code = 204 uri = /switch-ports
22342024-12-21T00:49:57.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41782 req_id = 263bd74c-e508-4abf-887a-d81194fe8524 response_code = 200 uri = /network-bootstore-config
22352024-12-21T00:49:59.739ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6862 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = a6865236-83a8-4cd4-9857-2412a9397a55 response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
22362024-12-21T00:50:04.662ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56211
22372024-12-21T00:50:04.662ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56211 req_id = 283b949e-0208-48ac-8679-929adfe4f227 response_code = 200 uri = /baseboard
22382024-12-21T00:50:25.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46458
22392024-12-21T00:50:25.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46458 req_id = ad7c15a8-7d27-4a7c-9144-d4871a1fa8ff response_code = 200 uri = /vpc-routes
22402024-12-21T00:50:25.698ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
22412024-12-21T00:50:25.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46458 req_id = 57973e51-ae2d-44a6-a023-af48e3b7757c response_code = 204 uri = /eip-gateways
22422024-12-21T00:50:25.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46458 req_id = 762a22d8-90d2-403f-a80a-1b71df6628b7 response_code = 204 uri = /vpc-routes
22432024-12-21T00:50:25.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63762
22442024-12-21T00:50:25.744ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22452024-12-21T00:50:25.784ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22462024-12-21T00:50:25.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96116 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63762 req_id = 75160d73-ac94-4dda-af2a-0c42c3fe3311 response_code = 204 uri = /switch-ports
22472024-12-21T00:50:25.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34914
22482024-12-21T00:50:25.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34914 req_id = 1863d247-2440-4de9-ac89-0d5862e96f7a response_code = 200 uri = /v2p
22492024-12-21T00:50:25.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63762 req_id = 88155109-ccf0-47bc-9e9a-72b765b65e03 response_code = 200 uri = /network-bootstore-config
22502024-12-21T00:50:26.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47791
22512024-12-21T00:50:26.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47791 req_id = 976c0c95-c5c5-470b-8d53-041dbb1352e8 response_code = 200 uri = /vpc-routes
22522024-12-21T00:50:26.812ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
22532024-12-21T00:50:26.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47791 req_id = 9f7a747c-aac6-47df-a7ae-123fe2c5a7f4 response_code = 204 uri = /eip-gateways
22542024-12-21T00:50:26.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55702
22552024-12-21T00:50:26.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55702 req_id = 0cf500d3-4b7e-485a-ba26-38d8e8da7fbe response_code = 200 uri = /v2p
22562024-12-21T00:50:26.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47791 req_id = d9ec169a-37a6-47a2-bc6e-c60244a20f1e response_code = 204 uri = /vpc-routes
22572024-12-21T00:50:26.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60415
22582024-12-21T00:50:26.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60415 req_id = c242ce50-c879-4fe3-8066-cfeca83047d8 response_code = 200 uri = /vpc-routes
22592024-12-21T00:50:26.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46734
22602024-12-21T00:50:26.889ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22612024-12-21T00:50:26.930ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22622024-12-21T00:50:26.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100034 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46734 req_id = 9d85a32c-f234-4f25-8642-5381318690eb response_code = 204 uri = /switch-ports
22632024-12-21T00:50:26.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59161
22642024-12-21T00:50:26.990ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
22652024-12-21T00:50:26.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60415 req_id = 73199c8c-6d8d-45c4-855f-e1685c1ecdde response_code = 204 uri = /eip-gateways
22662024-12-21T00:50:26.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32797
22672024-12-21T00:50:26.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46734 req_id = 0b99bd03-976c-4c51-baf4-2f294347902c response_code = 200 uri = /network-bootstore-config
22682024-12-21T00:50:26.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59161 req_id = 13dd8252-eeec-4f4e-b7e2-9a299626e602 response_code = 200 uri = /v2p
22692024-12-21T00:50:26.990ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22702024-12-21T00:50:26.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60415 req_id = fea11a3f-8283-4367-82e5-5d43a115d788 response_code = 204 uri = /vpc-routes
22712024-12-21T00:50:27.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22722024-12-21T00:50:27.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92734 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32797 req_id = c6b25c5b-cbba-4879-89d1-e85ab947084e response_code = 204 uri = /switch-ports
22732024-12-21T00:50:27.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32797 req_id = 24785182-6350-4bb4-9b71-d24239c2dd1e response_code = 200 uri = /network-bootstore-config
22742024-12-21T00:50:29.741ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8407 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = bb83df17-4b18-4db1-bf0a-5a6612f8457b response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
22752024-12-21T00:50:34.697ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64658
22762024-12-21T00:50:34.697ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64658 req_id = 633853c3-1932-407d-b52a-beda0642eadb response_code = 200 uri = /baseboard
22772024-12-21T00:50:55.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57124
22782024-12-21T00:50:55.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57124 req_id = 1a5797b5-bd00-4e41-b1b4-1fda6801a99e response_code = 200 uri = /vpc-routes
22792024-12-21T00:50:56.037ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
22802024-12-21T00:50:56.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57124 req_id = 5efd2a12-8962-407b-a53d-2140f7a6f960 response_code = 204 uri = /eip-gateways
22812024-12-21T00:50:56.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63998
22822024-12-21T00:50:56.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63998 req_id = d9bf9639-620f-479a-9c86-5ec91f11858e response_code = 200 uri = /v2p
22832024-12-21T00:50:56.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57124 req_id = 0389faf9-29b5-402e-85a0-5d6fec8d4ae2 response_code = 204 uri = /vpc-routes
22842024-12-21T00:50:56.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65215
22852024-12-21T00:50:56.194ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22862024-12-21T00:50:56.235ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22872024-12-21T00:50:56.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96691 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65215 req_id = 6e9a5d45-1cae-4424-962b-0db8d40b2d00 response_code = 204 uri = /switch-ports
22882024-12-21T00:50:56.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65215 req_id = e39754ef-5ba5-42c6-8dbb-42e2d6f2588d response_code = 200 uri = /network-bootstore-config
22892024-12-21T00:50:56.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45191
22902024-12-21T00:50:56.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45191 req_id = 33b87e50-7336-40a2-b6af-45d873a5555d response_code = 200 uri = /vpc-routes
22912024-12-21T00:50:56.818ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
22922024-12-21T00:50:56.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45191 req_id = ed6810d5-d1a6-4f39-bcdb-c498d8cd0831 response_code = 204 uri = /eip-gateways
22932024-12-21T00:50:56.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45191 req_id = 3777e00e-86b5-4bfc-97e8-3db7d483155d response_code = 204 uri = /vpc-routes
22942024-12-21T00:50:56.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53206
22952024-12-21T00:50:56.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53206 req_id = cb7823a7-6ecc-47c4-88e2-ad73f716ea22 response_code = 200 uri = /vpc-routes
22962024-12-21T00:50:56.962ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
22972024-12-21T00:50:56.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53206 req_id = ffe48f5d-1288-42ea-936a-3abc0af1744d response_code = 204 uri = /eip-gateways
22982024-12-21T00:50:56.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53206 req_id = 7d5b6627-7f26-4a78-9c19-f47e319eb135 response_code = 204 uri = /vpc-routes
22992024-12-21T00:50:56.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62950
23002024-12-21T00:50:56.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62950 req_id = e0151a6b-2185-4e09-ba1f-cac50254e4ae response_code = 200 uri = /v2p
23012024-12-21T00:50:56.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51445
23022024-12-21T00:50:56.995ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23032024-12-21T00:50:57.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23042024-12-21T00:50:57.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98201 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51445 req_id = d78874e6-f70b-4c8e-bae7-652eccf7a667 response_code = 204 uri = /switch-ports
23052024-12-21T00:50:57.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51445 req_id = 5dd61aa3-caac-4b38-b665-2d4c690edd12 response_code = 200 uri = /network-bootstore-config
23062024-12-21T00:50:57.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46513
23072024-12-21T00:50:57.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46513 req_id = 6558c353-e491-4436-a41d-241ca02cb7a4 response_code = 200 uri = /v2p
23082024-12-21T00:50:57.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36398
23092024-12-21T00:50:57.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23102024-12-21T00:50:57.226ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23112024-12-21T00:50:57.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36398 req_id = 944918a8-ae27-4ac2-b25d-71c2f2aa119d response_code = 204 uri = /switch-ports
23122024-12-21T00:50:57.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36398 req_id = b7af9524-c6d4-49d0-a327-d01549e726fb response_code = 200 uri = /network-bootstore-config
23132024-12-21T00:50:59.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7322 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 5f9504c3-9183-4e2e-aef1-f70fd3eabedd response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
23142024-12-21T00:51:04.729ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33859
23152024-12-21T00:51:04.730ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33859 req_id = 91ed2000-7deb-4815-904a-9f76b29fb907 response_code = 200 uri = /baseboard
23162024-12-21T00:51:25.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37093
23172024-12-21T00:51:25.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37093 req_id = 637789f8-9150-4f41-a533-e3cc3255af69 response_code = 200 uri = /vpc-routes
23182024-12-21T00:51:25.732ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
23192024-12-21T00:51:25.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37093 req_id = 00f379a0-4929-4382-a563-010ede7e4dbe response_code = 204 uri = /eip-gateways
23202024-12-21T00:51:25.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37093 req_id = 04e57f5d-071e-4171-b609-d3651ce0405b response_code = 204 uri = /vpc-routes
23212024-12-21T00:51:25.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42501
23222024-12-21T00:51:25.796ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23232024-12-21T00:51:25.834ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23242024-12-21T00:51:25.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96517 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42501 req_id = 1bcf43de-6c74-45ba-91cb-34229ef1ee5a response_code = 204 uri = /switch-ports
23252024-12-21T00:51:25.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42501 req_id = 8424eb07-49f4-407a-abe4-c90a41f84f25 response_code = 200 uri = /network-bootstore-config
23262024-12-21T00:51:25.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61352
23272024-12-21T00:51:25.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61352 req_id = eb956318-0e04-48f6-aca6-f0d067fc688e response_code = 200 uri = /v2p
23282024-12-21T00:51:26.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60376
23292024-12-21T00:51:26.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60376 req_id = db8a3d23-6607-47ca-bebc-a07858d95a72 response_code = 200 uri = /vpc-routes
23302024-12-21T00:51:26.740ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
23312024-12-21T00:51:26.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60376 req_id = a262374b-f83e-47ed-b3e9-51fb1a2486f8 response_code = 204 uri = /eip-gateways
23322024-12-21T00:51:26.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45081
23332024-12-21T00:51:26.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45081 req_id = 3004a0b3-26ee-4c82-8b6b-5161fe2f429a response_code = 200 uri = /vpc-routes
23342024-12-21T00:51:26.808ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
23352024-12-21T00:51:26.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45081 req_id = e9232899-75b0-4a5b-8aca-c0ff1c729666 response_code = 204 uri = /eip-gateways
23362024-12-21T00:51:26.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41391
23372024-12-21T00:51:26.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41391 req_id = 5090a0a5-46f0-4b7b-85f0-349ca67011b7 response_code = 200 uri = /v2p
23382024-12-21T00:51:26.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45081 req_id = 036b1076-6823-42f2-8e8c-a6638cfeaf42 response_code = 204 uri = /vpc-routes
23392024-12-21T00:51:26.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60376 req_id = 078ffe6f-78b8-405b-be1f-cf14131de938 response_code = 204 uri = /vpc-routes
23402024-12-21T00:51:26.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45318
23412024-12-21T00:51:26.847ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23422024-12-21T00:51:26.890ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23432024-12-21T00:51:26.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102530 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45318 req_id = b9fb288f-2763-41ef-a86d-e6b877be9c19 response_code = 204 uri = /switch-ports
23442024-12-21T00:51:26.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55222
23452024-12-21T00:51:26.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44151
23462024-12-21T00:51:26.950ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23472024-12-21T00:51:26.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45318 req_id = b4934ede-160e-49e8-8543-01cba039374a response_code = 200 uri = /network-bootstore-config
23482024-12-21T00:51:26.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44151 req_id = 63d808bc-1dfb-4725-aa68-711c5c1718f3 response_code = 200 uri = /v2p
23492024-12-21T00:51:26.985ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23502024-12-21T00:51:27.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92198 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55222 req_id = f05ffc13-0702-4a6b-aa1e-af87be466bcb response_code = 204 uri = /switch-ports
23512024-12-21T00:51:27.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55222 req_id = c3884205-1fa9-4093-bd3f-90680f77d9eb response_code = 200 uri = /network-bootstore-config
23522024-12-21T00:51:29.739ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6472 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 687ecb03-7ae7-4101-9071-cf298206250e response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
23532024-12-21T00:51:34.762ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61843
23542024-12-21T00:51:34.762ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61843 req_id = d746434d-2c8e-453a-8f67-f18ae661e30e response_code = 200 uri = /baseboard
23552024-12-21T00:51:55.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44984
23562024-12-21T00:51:55.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44984 req_id = 1374e6ab-6061-485b-bec7-646bf8ee71a0 response_code = 200 uri = /vpc-routes
23572024-12-21T00:51:55.810ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
23582024-12-21T00:51:55.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44984 req_id = 6824c20d-40eb-4041-b553-6cc3e36801d1 response_code = 204 uri = /eip-gateways
23592024-12-21T00:51:55.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44984 req_id = d8a2b059-b462-4aa0-a099-48f293ef2e05 response_code = 204 uri = /vpc-routes
23602024-12-21T00:51:55.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64059
23612024-12-21T00:51:55.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64059 req_id = 560e7aa0-2818-48c5-8f2f-0adc006144d1 response_code = 200 uri = /v2p
23622024-12-21T00:51:55.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54080
23632024-12-21T00:51:55.991ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23642024-12-21T00:51:56.031ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23652024-12-21T00:51:56.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97543 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54080 req_id = 45b67c9d-6cee-4c3f-ad84-cea5fedf4fda response_code = 204 uri = /switch-ports
23662024-12-21T00:51:56.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54080 req_id = 5100d015-e5a5-4d6c-807f-459f07d3b9d4 response_code = 200 uri = /network-bootstore-config
23672024-12-21T00:51:56.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33171
23682024-12-21T00:51:56.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33171 req_id = 86e6a5ea-d3c7-4c85-aa51-7059fc6e8cf7 response_code = 200 uri = /vpc-routes
23692024-12-21T00:51:56.816ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
23702024-12-21T00:51:56.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33171 req_id = aab9856b-c248-41f5-8e65-9f1951575e60 response_code = 204 uri = /eip-gateways
23712024-12-21T00:51:56.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38450
23722024-12-21T00:51:56.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38450 req_id = b1e85686-c1be-4f1c-aec5-05ec5dcc7924 response_code = 200 uri = /v2p
23732024-12-21T00:51:56.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33171 req_id = 217bfb4e-d23f-44d1-9a7b-64219173e890 response_code = 204 uri = /vpc-routes
23742024-12-21T00:51:56.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45141
23752024-12-21T00:51:56.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45141 req_id = 104a718e-7c53-4ec7-954e-0a70c90ef760 response_code = 200 uri = /vpc-routes
23762024-12-21T00:51:56.955ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
23772024-12-21T00:51:56.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45141 req_id = 2e61d07e-6bf2-46ca-a9b9-30fe1938bbd5 response_code = 204 uri = /eip-gateways
23782024-12-21T00:51:56.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45141 req_id = 30e19560-f460-49c1-9702-bd582bbd8fa8 response_code = 204 uri = /vpc-routes
23792024-12-21T00:51:57.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60280
23802024-12-21T00:51:57.020ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23812024-12-21T00:51:57.060ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23822024-12-21T00:51:57.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97463 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60280 req_id = fab6140b-be60-4ddc-b6c4-db001291c462 response_code = 204 uri = /switch-ports
23832024-12-21T00:51:57.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55263
23842024-12-21T00:51:57.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60252
23852024-12-21T00:51:57.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60280 req_id = 9fb636ad-7f3b-47c7-9ca1-bf77200e7375 response_code = 200 uri = /network-bootstore-config
23862024-12-21T00:51:57.119ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23872024-12-21T00:51:57.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55263 req_id = 77343c4e-cf08-433a-9834-12bb4a9f3665 response_code = 200 uri = /v2p
23882024-12-21T00:51:57.158ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23892024-12-21T00:51:57.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96474 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60252 req_id = 22ce0f53-b7da-466a-9fe6-2449cc7d76eb response_code = 204 uri = /switch-ports
23902024-12-21T00:51:57.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60252 req_id = 0766dab5-3ebb-44df-b100-c2a59af8a69b response_code = 200 uri = /network-bootstore-config
23912024-12-21T00:51:59.739ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6752 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = c87eb033-9992-4f91-bdc1-a2159fb5f024 response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
23922024-12-21T00:52:04.795ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61793
23932024-12-21T00:52:04.795ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61793 req_id = b65cb1fc-e5d3-4dc8-b2af-851af107637b response_code = 200 uri = /baseboard
23942024-12-21T00:52:25.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46635
23952024-12-21T00:52:25.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46635 req_id = 3be67e75-7e4a-4f86-a59e-59c5c10d84da response_code = 200 uri = /vpc-routes
23962024-12-21T00:52:25.677ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
23972024-12-21T00:52:25.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46635 req_id = 7f99f3f6-0f50-420c-b5f9-e66fcef8bc02 response_code = 204 uri = /eip-gateways
23982024-12-21T00:52:25.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46635 req_id = efea178b-9e9f-4864-b1f7-1e2361f36be2 response_code = 204 uri = /vpc-routes
23992024-12-21T00:52:25.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50412
24002024-12-21T00:52:25.726ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24012024-12-21T00:52:25.766ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24022024-12-21T00:52:25.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99134 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50412 req_id = 2d6256c8-2ce6-49d9-8f92-0e04db654bda response_code = 204 uri = /switch-ports
24032024-12-21T00:52:25.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58379
24042024-12-21T00:52:25.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58379 req_id = abe1ff82-c253-4268-afc4-eda0bbefec55 response_code = 200 uri = /v2p
24052024-12-21T00:52:25.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50412 req_id = c1386eed-0b4f-42bd-9564-4a7609a29f18 response_code = 200 uri = /network-bootstore-config
24062024-12-21T00:52:26.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50567
24072024-12-21T00:52:26.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50567 req_id = 58d988fa-97a1-4038-9740-2affeb4482cd response_code = 200 uri = /vpc-routes
24082024-12-21T00:52:26.692ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
24092024-12-21T00:52:26.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50567 req_id = 84a795c0-d020-4b87-9eb1-ebc361884864 response_code = 204 uri = /eip-gateways
24102024-12-21T00:52:26.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50567 req_id = 8c80c750-c363-47ad-af29-5189ed8ca966 response_code = 204 uri = /vpc-routes
24112024-12-21T00:52:26.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53894
24122024-12-21T00:52:26.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53894 req_id = dc2761db-861c-4815-b0c3-4a0ee84c9782 response_code = 200 uri = /v2p
24132024-12-21T00:52:26.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34873
24142024-12-21T00:52:26.816ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24152024-12-21T00:52:26.856ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24162024-12-21T00:52:26.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96091 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34873 req_id = 2b14787a-a0f5-4538-abe1-045b6c18dffe response_code = 204 uri = /switch-ports
24172024-12-21T00:52:26.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36394
24182024-12-21T00:52:26.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45801
24192024-12-21T00:52:26.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45801 req_id = 38b82e13-66dd-4ed4-a974-f58f4e846a60 response_code = 200 uri = /v2p
24202024-12-21T00:52:26.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36394 req_id = b5ea1ce4-d84d-4416-9554-3cc8f2eeccf0 response_code = 200 uri = /vpc-routes
24212024-12-21T00:52:26.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34873 req_id = d48a568f-a8d9-460d-988e-bb9a7391952e response_code = 200 uri = /network-bootstore-config
24222024-12-21T00:52:26.927ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
24232024-12-21T00:52:26.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36394 req_id = cbdbf5dc-03cc-4ce5-bdfa-044d167606ca response_code = 204 uri = /eip-gateways
24242024-12-21T00:52:26.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36394 req_id = 1fc27c22-a0ed-4229-9614-c4066e756d91 response_code = 204 uri = /vpc-routes
24252024-12-21T00:52:26.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33006
24262024-12-21T00:52:26.954ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24272024-12-21T00:52:26.992ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24282024-12-21T00:52:27.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33006 req_id = 89f85e4c-d465-41d4-844e-c9af2d1dce6f response_code = 204 uri = /switch-ports
24292024-12-21T00:52:27.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33006 req_id = 09aef41d-2ab7-4f9c-8001-4692b5dcab48 response_code = 200 uri = /network-bootstore-config
24302024-12-21T00:52:29.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6613 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = f4394dc0-077a-461c-a3b3-da4acf3b2e98 response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
24312024-12-21T00:52:34.826ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36282
24322024-12-21T00:52:34.826ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36282 req_id = 567e2b5a-e8c5-4e00-a6e0-3804144af12d response_code = 200 uri = /baseboard
24332024-12-21T00:52:55.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62434
24342024-12-21T00:52:55.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62434 req_id = f5e672da-5249-426a-b5c5-4fcda43f4bce response_code = 200 uri = /vpc-routes
24352024-12-21T00:52:55.784ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
24362024-12-21T00:52:55.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62434 req_id = c72feef9-7ec9-4110-a634-bc9a6ca34fef response_code = 204 uri = /eip-gateways
24372024-12-21T00:52:55.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62434 req_id = 1bc0d6a2-e459-4f61-8b4a-658ce7c60211 response_code = 204 uri = /vpc-routes
24382024-12-21T00:52:55.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60567
24392024-12-21T00:52:55.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60567 req_id = 14bf89a2-35ae-4127-86f3-d93ee474cc76 response_code = 200 uri = /v2p
24402024-12-21T00:52:55.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50951
24412024-12-21T00:52:55.986ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24422024-12-21T00:52:56.026ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24432024-12-21T00:52:56.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50951 req_id = c3017935-ab2b-4174-b7c8-47f0d4e4aad3 response_code = 204 uri = /switch-ports
24442024-12-21T00:52:56.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50951 req_id = 4de82289-9ac9-4ad0-a7a7-5e40e24f8fa1 response_code = 200 uri = /network-bootstore-config
24452024-12-21T00:52:56.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40335
24462024-12-21T00:52:56.112ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6887e424-c467-4dc7-a8b3-00acc28971d2, kind: Service { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 }, name: Name("external-dns-3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e8e123f1-5057-4c14-a500-5a66ca1807d8, kind: Service { id: 9df62edf-ae77-467e-8386-2594d7931d90 }, name: Name("external-dns-9df62edf-ae77-467e-8386-2594d7931d90"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 190])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104166fa-0281-40e0-a912-f30ba4e7f1c0, kind: Service { id: 3b31669e-ed79-4765-9f80-c063c63fac2d }, name: Name("nexus-3b31669e-ed79-4765-9f80-c063c63fac2d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 150b0c67-783e-4dab-936e-88cb1fe1cda3, kind: Service { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 }, name: Name("nexus-176c56ae-3f0a-4c04-a40a-300d58486e34"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c44fd269-5de0-4bbf-8a47-97be7cf8ce40, kind: Service { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 }, name: Name("nexus-af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24472024-12-21T00:52:56.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24482024-12-21T00:52:56.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24492024-12-21T00:52:56.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24502024-12-21T00:52:56.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24512024-12-21T00:52:56.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24522024-12-21T00:52:56.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24532024-12-21T00:52:56.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40335 req_id = cd3d5225-5d5d-47d6-86be-dae2198470d8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24542024-12-21T00:52:56.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39056
24552024-12-21T00:52:56.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39056 req_id = f03deb46-9ea7-41e5-a86f-b44478e49ca1 response_code = 200 uri = /vpc-routes
24562024-12-21T00:52:56.761ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
24572024-12-21T00:52:56.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39056 req_id = 8c1ca8f8-82a5-4150-bff7-1aa93813fc63 response_code = 204 uri = /eip-gateways
24582024-12-21T00:52:56.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39056 req_id = f3b945c8-8d14-42f3-bb95-8158516dfd7c response_code = 204 uri = /vpc-routes
24592024-12-21T00:52:56.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60296
24602024-12-21T00:52:56.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60296 req_id = 04a0fd53-4b44-44ad-b11d-f716df8469c4 response_code = 200 uri = /vpc-routes
24612024-12-21T00:52:56.921ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
24622024-12-21T00:52:56.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60296 req_id = b142df3f-46b8-4349-a2b9-87bb70ad55db response_code = 204 uri = /eip-gateways
24632024-12-21T00:52:56.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39488
24642024-12-21T00:52:56.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39488 req_id = 4203363b-4912-4025-a81c-cc1a367e8e68 response_code = 200 uri = /v2p
24652024-12-21T00:52:57.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37423
24662024-12-21T00:52:57.015ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24672024-12-21T00:52:57.055ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24682024-12-21T00:52:57.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102260 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37423 req_id = 8f5b2980-5ffe-42e7-851b-17ad1a816424 response_code = 204 uri = /switch-ports
24692024-12-21T00:52:57.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54142
24702024-12-21T00:52:57.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48751
24712024-12-21T00:52:57.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37423 req_id = 3d558905-411c-4096-864d-04971fa20907 response_code = 200 uri = /network-bootstore-config
24722024-12-21T00:52:57.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 595 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60296 req_id = 9508ae06-f304-491d-8379-621a439943fd response_code = 204 uri = /vpc-routes
24732024-12-21T00:52:57.118ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6887e424-c467-4dc7-a8b3-00acc28971d2, kind: Service { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 }, name: Name("external-dns-3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e8e123f1-5057-4c14-a500-5a66ca1807d8, kind: Service { id: 9df62edf-ae77-467e-8386-2594d7931d90 }, name: Name("external-dns-9df62edf-ae77-467e-8386-2594d7931d90"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 190])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104166fa-0281-40e0-a912-f30ba4e7f1c0, kind: Service { id: 3b31669e-ed79-4765-9f80-c063c63fac2d }, name: Name("nexus-3b31669e-ed79-4765-9f80-c063c63fac2d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 150b0c67-783e-4dab-936e-88cb1fe1cda3, kind: Service { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 }, name: Name("nexus-176c56ae-3f0a-4c04-a40a-300d58486e34"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c44fd269-5de0-4bbf-8a47-97be7cf8ce40, kind: Service { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 }, name: Name("nexus-af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24742024-12-21T00:52:57.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54142 req_id = 383ed875-769b-4eec-afaa-08bbbf2f40b4 response_code = 200 uri = /v2p
24752024-12-21T00:52:57.118ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24762024-12-21T00:52:57.118ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24772024-12-21T00:52:57.118ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24782024-12-21T00:52:57.118ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24792024-12-21T00:52:57.118ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24802024-12-21T00:52:57.118ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24812024-12-21T00:52:57.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 594 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48751 req_id = 758f7b4a-b85a-48a2-8c2f-e6b7baa6af02 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24822024-12-21T00:52:57.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51348
24832024-12-21T00:52:57.185ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24842024-12-21T00:52:57.223ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24852024-12-21T00:52:57.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100173 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51348 req_id = 2f23fb24-efe8-4c4b-b586-465778a860ff response_code = 204 uri = /switch-ports
24862024-12-21T00:52:57.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51348 req_id = 1914ac96-1d94-4cf0-b3c5-9e32d777e9eb response_code = 200 uri = /network-bootstore-config
24872024-12-21T00:52:57.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50182
24882024-12-21T00:52:57.331ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6887e424-c467-4dc7-a8b3-00acc28971d2, kind: Service { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 }, name: Name("external-dns-3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e8e123f1-5057-4c14-a500-5a66ca1807d8, kind: Service { id: 9df62edf-ae77-467e-8386-2594d7931d90 }, name: Name("external-dns-9df62edf-ae77-467e-8386-2594d7931d90"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 190])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104166fa-0281-40e0-a912-f30ba4e7f1c0, kind: Service { id: 3b31669e-ed79-4765-9f80-c063c63fac2d }, name: Name("nexus-3b31669e-ed79-4765-9f80-c063c63fac2d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 150b0c67-783e-4dab-936e-88cb1fe1cda3, kind: Service { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 }, name: Name("nexus-176c56ae-3f0a-4c04-a40a-300d58486e34"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c44fd269-5de0-4bbf-8a47-97be7cf8ce40, kind: Service { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 }, name: Name("nexus-af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24892024-12-21T00:52:57.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24902024-12-21T00:52:57.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24912024-12-21T00:52:57.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24922024-12-21T00:52:57.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24932024-12-21T00:52:57.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24942024-12-21T00:52:57.331ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24952024-12-21T00:52:57.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50182 req_id = 8bc77f34-3ff9-48cb-8512-a3404415185b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24962024-12-21T00:52:59.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7280 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 00568f6e-83b9-4058-9993-4576b2515466 response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
24972024-12-21T00:53:04.860ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57707
24982024-12-21T00:53:04.860ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57707 req_id = 6fcc2f7d-b657-4d7e-867c-ca828aa01987 response_code = 200 uri = /baseboard
24992024-12-21T00:53:25.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37335
25002024-12-21T00:53:25.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37335 req_id = e055b776-096a-406b-93c7-261f388dca7d response_code = 200 uri = /vpc-routes
25012024-12-21T00:53:25.651ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
25022024-12-21T00:53:25.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37335 req_id = 0b73e8c0-e376-46e6-8307-93676b59f206 response_code = 204 uri = /eip-gateways
25032024-12-21T00:53:25.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37335 req_id = a760e0b6-d036-46bd-b43b-f2c942d689fc response_code = 204 uri = /vpc-routes
25042024-12-21T00:53:25.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33861
25052024-12-21T00:53:25.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33861 req_id = d67bfd24-aa31-4768-9af6-d36812e1e1cb response_code = 200 uri = /v2p
25062024-12-21T00:53:25.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47984
25072024-12-21T00:53:25.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25082024-12-21T00:53:25.884ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25092024-12-21T00:53:25.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99356 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47984 req_id = e9ffca80-b275-429c-9e01-782d6361780d response_code = 204 uri = /switch-ports
25102024-12-21T00:53:25.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47984 req_id = ed8477e8-8425-460e-926d-77bfc015d40e response_code = 200 uri = /network-bootstore-config
25112024-12-21T00:53:26.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62521
25122024-12-21T00:53:26.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62521 req_id = fb24e479-1f5d-4e16-8661-ef68577d73ed response_code = 200 uri = /vpc-routes
25132024-12-21T00:53:26.737ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
25142024-12-21T00:53:26.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62521 req_id = 46ea007f-b166-4bcd-a35e-de521c8b56b5 response_code = 204 uri = /eip-gateways
25152024-12-21T00:53:26.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35148
25162024-12-21T00:53:26.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35148 req_id = 0b088a81-d02a-41cd-9f4a-dcc85d2b1d09 response_code = 200 uri = /v2p
25172024-12-21T00:53:26.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62521 req_id = 71bd0af8-0b97-4899-b16c-d5b1e8441935 response_code = 204 uri = /vpc-routes
25182024-12-21T00:53:26.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41137
25192024-12-21T00:53:26.821ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25202024-12-21T00:53:26.860ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25212024-12-21T00:53:26.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94888 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41137 req_id = 2a0c5153-fa9b-4769-a4a4-ee2808d271ff response_code = 204 uri = /switch-ports
25222024-12-21T00:53:26.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65225
25232024-12-21T00:53:26.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65225 req_id = 00ce88e8-39b9-4c45-a53b-937a81cf499d response_code = 200 uri = /vpc-routes
25242024-12-21T00:53:26.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41137 req_id = 4b4d3bc8-7649-4c8f-be48-2f68fb47dd35 response_code = 200 uri = /network-bootstore-config
25252024-12-21T00:53:26.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46893
25262024-12-21T00:53:26.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46893 req_id = eca84376-706c-4fe2-a115-6fc644efa944 response_code = 200 uri = /v2p
25272024-12-21T00:53:26.960ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
25282024-12-21T00:53:26.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65225 req_id = 047e3fce-e32f-4289-afbe-b63a135e6a3a response_code = 204 uri = /eip-gateways
25292024-12-21T00:53:26.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61456
25302024-12-21T00:53:26.965ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25312024-12-21T00:53:27.003ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25322024-12-21T00:53:27.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91866 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61456 req_id = e427e5d9-45fd-4ef0-9a1b-a5eb16a7509f response_code = 204 uri = /switch-ports
25332024-12-21T00:53:27.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65225 req_id = 42b1fd20-4f9c-415c-a307-89d4deb08768 response_code = 204 uri = /vpc-routes
25342024-12-21T00:53:27.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61456 req_id = d02250e2-4e8d-43f5-b135-5b1ce401bf32 response_code = 200 uri = /network-bootstore-config
25352024-12-21T00:53:29.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7115 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 58433047-51d0-4e7c-9d15-ddc7be79df0f response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
25362024-12-21T00:53:34.893ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35682
25372024-12-21T00:53:34.893ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35682 req_id = 5dded380-9bbc-4fe4-b65f-e9bd8af91592 response_code = 200 uri = /baseboard
25382024-12-21T00:53:37.788ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
25392024-12-21T00:53:37.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25402024-12-21T00:53:37.819ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1949, tv_nsec: 312729584 } time_to_next_cleanup = 599.99999763s
25412024-12-21T00:53:51.919ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
25422024-12-21T00:53:55.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40538
25432024-12-21T00:53:55.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40538 req_id = a6283ab0-95f5-4d89-a07a-be7bad26c043 response_code = 200 uri = /vpc-routes
25442024-12-21T00:53:55.821ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
25452024-12-21T00:53:55.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40538 req_id = 2b575be4-9db5-4773-a7bb-8abda1abf070 response_code = 204 uri = /eip-gateways
25462024-12-21T00:53:55.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62932
25472024-12-21T00:53:55.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62932 req_id = 4432663f-d671-44a3-b087-28cb39a25e93 response_code = 200 uri = /v2p
25482024-12-21T00:53:55.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40538 req_id = 5dd3cc7f-4f79-4d8e-8d09-1b33e83afca1 response_code = 204 uri = /vpc-routes
25492024-12-21T00:53:56.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42059
25502024-12-21T00:53:56.038ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25512024-12-21T00:53:56.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25522024-12-21T00:53:56.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101157 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42059 req_id = e2dfc0df-a89b-4760-bc44-1bfb527962d5 response_code = 204 uri = /switch-ports
25532024-12-21T00:53:56.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42059 req_id = 4d2b319f-2f42-42a4-a9f5-16ae59b23f8e response_code = 200 uri = /network-bootstore-config
25542024-12-21T00:53:56.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46328
25552024-12-21T00:53:56.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46328 req_id = 554375a3-8137-49f7-956e-49f690f5d1d7 response_code = 200 uri = /vpc-routes
25562024-12-21T00:53:56.815ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
25572024-12-21T00:53:56.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46328 req_id = 754c8c2b-cf75-4dec-a7dd-6b0e62a3caa0 response_code = 204 uri = /eip-gateways
25582024-12-21T00:53:56.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46328 req_id = b8a43c65-865b-4154-9e52-70aed376ad51 response_code = 204 uri = /vpc-routes
25592024-12-21T00:53:56.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42996
25602024-12-21T00:53:56.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42996 req_id = 83a0fdb9-d0d4-4408-8a5b-7c2a6d8ac9e7 response_code = 200 uri = /v2p
25612024-12-21T00:53:57.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38630
25622024-12-21T00:53:57.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38630 req_id = a8d6b2e4-102d-4e61-bc9e-839b83fa4b02 response_code = 200 uri = /v2p
25632024-12-21T00:53:57.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36161
25642024-12-21T00:53:57.048ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25652024-12-21T00:53:57.085ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25662024-12-21T00:53:57.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90735 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36161 req_id = 5b4e7c18-c048-45b3-8f2d-346bce440830 response_code = 204 uri = /switch-ports
25672024-12-21T00:53:57.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40683
25682024-12-21T00:53:57.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60506
25692024-12-21T00:53:57.139ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25702024-12-21T00:53:57.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3633 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36161 req_id = 891d4af7-8afa-4859-a347-14958bbf9456 response_code = 200 uri = /network-bootstore-config
25712024-12-21T00:53:57.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3743 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40683 req_id = 062761f4-88f9-4164-aaed-27f32bedd16e response_code = 200 uri = /vpc-routes
25722024-12-21T00:53:57.159ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
25732024-12-21T00:53:57.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40683 req_id = d4a05d87-ffa4-4bb6-989f-5e3cdc794166 response_code = 204 uri = /eip-gateways
25742024-12-21T00:53:57.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40683 req_id = 5900954a-1c1f-44fb-9eaa-269893758b80 response_code = 204 uri = /vpc-routes
25752024-12-21T00:53:57.178ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25762024-12-21T00:53:57.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93720 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60506 req_id = 3ca0d11e-6314-469d-ac85-89aa5f5546a8 response_code = 204 uri = /switch-ports
25772024-12-21T00:53:57.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60506 req_id = 901854b7-4aae-4c5d-ad7d-e1f074a0a60b response_code = 200 uri = /network-bootstore-config
25782024-12-21T00:53:59.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7303 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = fb5f1cf1-c812-4265-8bfc-4e3da40403ba response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
25792024-12-21T00:54:04.927ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59566
25802024-12-21T00:54:04.927ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59566 req_id = ba64a5cc-3368-4980-872c-63edd9cbcb9e response_code = 200 uri = /baseboard
25812024-12-21T00:54:25.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51163
25822024-12-21T00:54:25.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51163 req_id = 1ccd4337-bc79-443c-8d00-356ccae7d4c1 response_code = 200 uri = /vpc-routes
25832024-12-21T00:54:25.679ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
25842024-12-21T00:54:25.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51163 req_id = 39bbdc63-f428-4c40-aa82-a1a46a3500e5 response_code = 204 uri = /eip-gateways
25852024-12-21T00:54:25.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51163 req_id = a396b34a-eaa0-424c-a890-9b68ee6e093f response_code = 204 uri = /vpc-routes
25862024-12-21T00:54:25.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50784
25872024-12-21T00:54:25.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50784 req_id = ad78f6de-cbd6-41ea-8768-4e36e515819f response_code = 200 uri = /v2p
25882024-12-21T00:54:25.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56450
25892024-12-21T00:54:25.742ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25902024-12-21T00:54:25.783ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25912024-12-21T00:54:25.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56450 req_id = 360d7e90-dde6-4566-88b0-5cb327836fed response_code = 204 uri = /switch-ports
25922024-12-21T00:54:25.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56450 req_id = b61d43db-54a3-496d-bbf3-686e1691529a response_code = 200 uri = /network-bootstore-config
25932024-12-21T00:54:26.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63850
25942024-12-21T00:54:26.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63850 req_id = d0222a11-28f3-464c-b63e-7ce3356a58c4 response_code = 200 uri = /vpc-routes
25952024-12-21T00:54:26.696ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
25962024-12-21T00:54:26.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63850 req_id = 17fc7bbb-416d-4fd9-ac80-e6a4955ba804 response_code = 204 uri = /eip-gateways
25972024-12-21T00:54:26.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41524
25982024-12-21T00:54:26.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41524 req_id = 69049384-5bed-44d5-9c10-045cc4eef755 response_code = 200 uri = /v2p
25992024-12-21T00:54:26.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 380 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63850 req_id = b56e6835-e348-4939-b2d5-c76b44c2e1b5 response_code = 204 uri = /vpc-routes
26002024-12-21T00:54:26.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50067
26012024-12-21T00:54:26.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50067 req_id = 44256c47-12ec-470d-91d2-c350f90fef7d response_code = 200 uri = /vpc-routes
26022024-12-21T00:54:26.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58545
26032024-12-21T00:54:26.797ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26042024-12-21T00:54:26.838ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26052024-12-21T00:54:26.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101353 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58545 req_id = a16fb5d6-597a-4373-9472-9af32e467b9f response_code = 204 uri = /switch-ports
26062024-12-21T00:54:26.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
26072024-12-21T00:54:26.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50067 req_id = 387cf84f-f6fb-4a5b-bb79-713625c9555a response_code = 204 uri = /eip-gateways
26082024-12-21T00:54:26.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58545 req_id = 45698372-3690-4d77-b1fd-e6852b6b294f response_code = 200 uri = /network-bootstore-config
26092024-12-21T00:54:26.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47156
26102024-12-21T00:54:26.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47156 req_id = d2713b30-94e6-4801-9502-d96bc632afae response_code = 200 uri = /v2p
26112024-12-21T00:54:26.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50067 req_id = aedd7a44-1723-45b3-91f7-cf8cf858f43d response_code = 204 uri = /vpc-routes
26122024-12-21T00:54:26.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63335
26132024-12-21T00:54:26.978ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26142024-12-21T00:54:27.014ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26152024-12-21T00:54:27.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63335 req_id = 1e19e3d1-c88f-4e81-ab65-018c19dbb57f response_code = 204 uri = /switch-ports
26162024-12-21T00:54:27.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63335 req_id = c5ce3649-fa39-4083-82ae-899dc76d9925 response_code = 200 uri = /network-bootstore-config
26172024-12-21T00:54:29.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7339 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 579ac420-3715-48a4-969e-0eface9d0020 response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
26182024-12-21T00:54:34.960ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45781
26192024-12-21T00:54:34.960ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45781 req_id = 7babfabc-b9fd-4174-acaf-f85780d00d66 response_code = 200 uri = /baseboard
26202024-12-21T00:54:55.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50876
26212024-12-21T00:54:55.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50876 req_id = ec785e4b-c985-4faa-b887-851c2ae0aeb3 response_code = 200 uri = /vpc-routes
26222024-12-21T00:54:55.816ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
26232024-12-21T00:54:55.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50876 req_id = 9e792997-e067-4c96-a430-8b2ddb98a15e response_code = 204 uri = /eip-gateways
26242024-12-21T00:54:55.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50876 req_id = e22dc71c-6551-4381-8ae3-43aed4794ce7 response_code = 204 uri = /vpc-routes
26252024-12-21T00:54:55.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61495
26262024-12-21T00:54:55.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61495 req_id = cf7b083e-b9b7-4b76-8af2-0d7e88a60903 response_code = 200 uri = /v2p
26272024-12-21T00:54:55.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36982
26282024-12-21T00:54:55.942ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26292024-12-21T00:54:55.980ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26302024-12-21T00:54:56.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89400 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36982 req_id = ab9bb978-8383-4037-9e5b-f1a12675b602 response_code = 204 uri = /switch-ports
26312024-12-21T00:54:56.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36982 req_id = 6f13048d-c403-4f3b-9dd8-6517ff3584d0 response_code = 200 uri = /network-bootstore-config
26322024-12-21T00:54:56.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59620
26332024-12-21T00:54:56.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59620 req_id = 5a81b811-b185-4427-9115-466911bf86be response_code = 200 uri = /vpc-routes
26342024-12-21T00:54:56.796ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
26352024-12-21T00:54:56.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59620 req_id = 6abd311b-c8b6-4cd8-9754-025b3bf42e32 response_code = 204 uri = /eip-gateways
26362024-12-21T00:54:56.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59620 req_id = 40486fd6-adb6-4b3a-a6fa-2b30748c9de8 response_code = 204 uri = /vpc-routes
26372024-12-21T00:54:56.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54490
26382024-12-21T00:54:56.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54490 req_id = 1d9ce9c2-d79a-4d98-9e8a-3215dbf5eac7 response_code = 200 uri = /vpc-routes
26392024-12-21T00:54:56.982ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
26402024-12-21T00:54:56.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54490 req_id = d32e2b76-f5a3-4b55-960c-7417c94eccfa response_code = 204 uri = /eip-gateways
26412024-12-21T00:54:56.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61971
26422024-12-21T00:54:56.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61971 req_id = c1f815e4-64a3-48f2-b1c8-a4599828efdd response_code = 200 uri = /v2p
26432024-12-21T00:54:56.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54490 req_id = ef97fbcd-f651-43aa-9750-fb940a758ab2 response_code = 204 uri = /vpc-routes
26442024-12-21T00:54:57.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50741
26452024-12-21T00:54:57.163ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26462024-12-21T00:54:57.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26472024-12-21T00:54:57.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95302 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50741 req_id = cdf840bb-c32c-44ec-981e-b0f9a80912bb response_code = 204 uri = /switch-ports
26482024-12-21T00:54:57.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46429
26492024-12-21T00:54:57.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57972
26502024-12-21T00:54:57.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50741 req_id = 4679c18e-f791-4a70-9414-9653a59dede6 response_code = 200 uri = /network-bootstore-config
26512024-12-21T00:54:57.259ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26522024-12-21T00:54:57.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46429 req_id = af9a9500-6257-4375-8ae4-c9c6cabe62e6 response_code = 200 uri = /v2p
26532024-12-21T00:54:57.297ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26542024-12-21T00:54:57.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57972 req_id = fa69be70-9b7c-4003-8161-776483e754ab response_code = 204 uri = /switch-ports
26552024-12-21T00:54:57.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57972 req_id = 781acd3a-7f90-4d7f-af98-ee75c6f427c9 response_code = 200 uri = /network-bootstore-config
26562024-12-21T00:54:59.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7105 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = cf1f9c4f-6e90-4d3b-99eb-6c830c1c4722 response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
26572024-12-21T00:55:04.993ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60167
26582024-12-21T00:55:04.993ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60167 req_id = ea2686c4-c9e7-46f0-80a0-0849ab3bf071 response_code = 200 uri = /baseboard
26592024-12-21T00:55:25.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36155
26602024-12-21T00:55:25.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36155 req_id = d30d05da-4ea0-4acf-b893-6bc27429617f response_code = 200 uri = /vpc-routes
26612024-12-21T00:55:25.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
26622024-12-21T00:55:25.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36155 req_id = 1ffac497-2919-4c0b-a4f3-88549de79f52 response_code = 204 uri = /eip-gateways
26632024-12-21T00:55:25.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36155 req_id = 0590f639-e721-42fe-b270-219b674b4d72 response_code = 204 uri = /vpc-routes
26642024-12-21T00:55:25.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55707
26652024-12-21T00:55:25.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55707 req_id = c2ba6656-e23f-44d9-9109-ebafe5a758e3 response_code = 200 uri = /v2p
26662024-12-21T00:55:25.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44807
26672024-12-21T00:55:25.989ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26682024-12-21T00:55:26.032ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26692024-12-21T00:55:26.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98518 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44807 req_id = 91743774-87b0-493c-9674-4ea7b40f41c9 response_code = 204 uri = /switch-ports
26702024-12-21T00:55:26.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44807 req_id = efcca6c8-be0e-4a25-bc21-1ee3415e7b34 response_code = 200 uri = /network-bootstore-config
26712024-12-21T00:55:26.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43616
26722024-12-21T00:55:26.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43616 req_id = 92256546-336b-46f0-beab-00341085739e response_code = 200 uri = /vpc-routes
26732024-12-21T00:55:26.618ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
26742024-12-21T00:55:26.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43616 req_id = 047130e3-6b40-42c8-a5ec-83394c9ff63a response_code = 204 uri = /eip-gateways
26752024-12-21T00:55:26.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43616 req_id = 3b6beada-e7f0-4c51-8f88-ef731c8e9408 response_code = 204 uri = /vpc-routes
26762024-12-21T00:55:26.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54352
26772024-12-21T00:55:26.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54352 req_id = f895f834-4152-41f7-ae49-2922d30cf1ba response_code = 200 uri = /v2p
26782024-12-21T00:55:26.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60399
26792024-12-21T00:55:26.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60399 req_id = aab4f131-e5a4-47ee-b972-7a2ef4ffac97 response_code = 200 uri = /vpc-routes
26802024-12-21T00:55:26.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36309
26812024-12-21T00:55:26.847ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26822024-12-21T00:55:26.888ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26832024-12-21T00:55:26.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106755 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36309 req_id = c9e1ca5e-889f-4dee-9fed-3a3d12928ae2 response_code = 204 uri = /switch-ports
26842024-12-21T00:55:26.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65398
26852024-12-21T00:55:26.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
26862024-12-21T00:55:26.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60399 req_id = ada92251-e546-4182-ae82-34b5ae5af428 response_code = 204 uri = /eip-gateways
26872024-12-21T00:55:26.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36309 req_id = f3ab08e8-64ec-4540-8749-56266fb526c6 response_code = 200 uri = /network-bootstore-config
26882024-12-21T00:55:26.954ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26892024-12-21T00:55:26.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 430 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60399 req_id = 1bf9e366-1f8d-4232-9f70-ddb902115aff response_code = 204 uri = /vpc-routes
26902024-12-21T00:55:26.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54023
26912024-12-21T00:55:26.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54023 req_id = c25ac39c-f0a7-462e-8086-cce27ed04625 response_code = 200 uri = /v2p
26922024-12-21T00:55:26.993ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26932024-12-21T00:55:27.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94717 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65398 req_id = f95af5d9-dda4-42e4-9b32-5381e1b48315 response_code = 204 uri = /switch-ports
26942024-12-21T00:55:27.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65398 req_id = e831bd4b-07e4-47a5-9f54-9683fe4a8d0e response_code = 200 uri = /network-bootstore-config
26952024-12-21T00:55:29.739ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6735 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 93953a26-3dfc-439a-a8da-bedd856557d1 response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
26962024-12-21T00:55:35.027ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63551
26972024-12-21T00:55:35.027ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63551 req_id = 7885a379-af97-419c-8c68-94802c2f5f92 response_code = 200 uri = /baseboard
26982024-12-21T00:55:55.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35153
26992024-12-21T00:55:55.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35153 req_id = 00ebaf73-7e2c-4170-8c61-f07354601236 response_code = 200 uri = /vpc-routes
27002024-12-21T00:55:55.667ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
27012024-12-21T00:55:55.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35153 req_id = 7f3f0e4b-18ad-42ce-be04-5d1098764ad7 response_code = 204 uri = /eip-gateways
27022024-12-21T00:55:55.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35153 req_id = cc63160e-ad52-4a96-9f7e-4b950fe959a6 response_code = 204 uri = /vpc-routes
27032024-12-21T00:55:55.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49066
27042024-12-21T00:55:55.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49066 req_id = e8dca9ac-0ca3-40fd-a920-873e1a974e35 response_code = 200 uri = /v2p
27052024-12-21T00:55:56.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44034
27062024-12-21T00:55:56.010ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27072024-12-21T00:55:56.049ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27082024-12-21T00:55:56.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95209 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44034 req_id = af5d16ad-43ab-458c-b86f-e425057829aa response_code = 204 uri = /switch-ports
27092024-12-21T00:55:56.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44034 req_id = d8d8f27a-3e3a-451b-b25e-5403c5623176 response_code = 200 uri = /network-bootstore-config
27102024-12-21T00:55:56.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36960
27112024-12-21T00:55:56.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36960 req_id = 1967e9c6-bc1e-42c2-a68a-8a4f628f345a response_code = 200 uri = /vpc-routes
27122024-12-21T00:55:56.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46492
27132024-12-21T00:55:56.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46492 req_id = e6466a55-0da8-452c-9369-fe6150e5a9fa response_code = 200 uri = /v2p
27142024-12-21T00:55:56.853ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
27152024-12-21T00:55:56.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36960 req_id = cb9b50d7-8b0e-490d-89d7-7e69063ca4cb response_code = 204 uri = /eip-gateways
27162024-12-21T00:55:56.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36960 req_id = 6023bf31-da8c-4be3-8dcb-2b58cecb4433 response_code = 204 uri = /vpc-routes
27172024-12-21T00:55:56.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59978
27182024-12-21T00:55:56.972ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27192024-12-21T00:55:57.012ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27202024-12-21T00:55:57.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99779 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59978 req_id = ee70b0f6-3435-4b1f-954f-e257810e291d response_code = 204 uri = /switch-ports
27212024-12-21T00:55:57.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36328
27222024-12-21T00:55:57.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36328 req_id = 54ecaf74-464c-44cd-8a3b-fcef8bb90d40 response_code = 200 uri = /v2p
27232024-12-21T00:55:57.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59978 req_id = 38ee8e6d-4fd5-43c1-94a0-cb58d22dc1a9 response_code = 200 uri = /network-bootstore-config
27242024-12-21T00:55:57.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48845
27252024-12-21T00:55:57.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48845 req_id = eba12711-09a2-4231-a5be-03186fffbd73 response_code = 200 uri = /vpc-routes
27262024-12-21T00:55:57.152ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
27272024-12-21T00:55:57.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48845 req_id = fe205718-63b3-40a1-ad62-86bd1d2e0977 response_code = 204 uri = /eip-gateways
27282024-12-21T00:55:57.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48845 req_id = 182c797e-2719-4018-b017-4e88fba2ceb7 response_code = 204 uri = /vpc-routes
27292024-12-21T00:55:57.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57835
27302024-12-21T00:55:57.166ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27312024-12-21T00:55:57.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27322024-12-21T00:55:57.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91907 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57835 req_id = 79afde9e-38da-4dcc-a779-71928bac03ca response_code = 204 uri = /switch-ports
27332024-12-21T00:55:57.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57835 req_id = 19635a49-9c3b-44dd-ae51-bdc2679f28d8 response_code = 200 uri = /network-bootstore-config
27342024-12-21T00:55:59.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7868 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 87c4945b-6119-4d35-bd98-da34b1ae6a16 response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
27352024-12-21T00:56:05.060ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36501
27362024-12-21T00:56:05.060ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36501 req_id = 04a01479-51c9-411e-9efc-e0b627ccf398 response_code = 200 uri = /baseboard
27372024-12-21T00:56:25.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46893
27382024-12-21T00:56:25.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46893 req_id = 0752846b-0e80-47e4-a9bd-f3987b796181 response_code = 200 uri = /vpc-routes
27392024-12-21T00:56:25.794ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
27402024-12-21T00:56:25.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46893 req_id = d6a57d0d-9702-4a2a-bb98-fca131750adc response_code = 204 uri = /eip-gateways
27412024-12-21T00:56:25.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39081
27422024-12-21T00:56:25.801ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27432024-12-21T00:56:25.843ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27442024-12-21T00:56:25.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100327 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39081 req_id = 9a593935-b0c8-4dc5-be26-99820f2dae2f response_code = 204 uri = /switch-ports
27452024-12-21T00:56:25.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48374
27462024-12-21T00:56:25.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 487 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46893 req_id = c8267b45-db4c-4e84-9d5b-a1013196ab8e response_code = 204 uri = /vpc-routes
27472024-12-21T00:56:25.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39081 req_id = 547b1dc0-62aa-4b56-a140-2af173ae4cd1 response_code = 200 uri = /network-bootstore-config
27482024-12-21T00:56:25.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48374 req_id = 23f8dfb3-3b75-4605-ad9f-83fed3b49993 response_code = 200 uri = /v2p
27492024-12-21T00:56:26.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44102
27502024-12-21T00:56:26.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44102 req_id = 3e9cd999-8eb5-4385-a932-362ecb727307 response_code = 200 uri = /vpc-routes
27512024-12-21T00:56:26.743ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
27522024-12-21T00:56:26.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44102 req_id = 77dcdbde-3d11-4b39-891f-05409ed0bcb7 response_code = 204 uri = /eip-gateways
27532024-12-21T00:56:26.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46888
27542024-12-21T00:56:26.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46888 req_id = a0baee97-62cf-49be-b114-d883448e6b66 response_code = 200 uri = /vpc-routes
27552024-12-21T00:56:26.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59468
27562024-12-21T00:56:26.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59468 req_id = 2fe3b37f-b631-40c3-a2a6-05cc06d27968 response_code = 200 uri = /v2p
27572024-12-21T00:56:26.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44102 req_id = a6881356-e249-49aa-a117-00e390977292 response_code = 204 uri = /vpc-routes
27582024-12-21T00:56:26.790ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
27592024-12-21T00:56:26.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46888 req_id = 215bd07e-37fe-41bb-bc33-909d69c5c1cb response_code = 204 uri = /eip-gateways
27602024-12-21T00:56:26.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46888 req_id = 120bd031-dac2-4f7d-93ad-b3aedc99f900 response_code = 204 uri = /vpc-routes
27612024-12-21T00:56:26.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47225
27622024-12-21T00:56:26.875ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27632024-12-21T00:56:26.917ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27642024-12-21T00:56:26.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100188 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47225 req_id = 30eae647-15a5-4adb-9a5b-1200929e5fc1 response_code = 204 uri = /switch-ports
27652024-12-21T00:56:26.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50765
27662024-12-21T00:56:26.975ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27672024-12-21T00:56:27.008ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27682024-12-21T00:56:27.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88334 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50765 req_id = 3d8ad9e1-b7ad-4375-a4c9-0e0bbd30ca6d response_code = 204 uri = /switch-ports
27692024-12-21T00:56:27.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64618
27702024-12-21T00:56:27.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64618 req_id = 0e89aab4-2067-4399-8d67-63ddfa0cac6f response_code = 200 uri = /v2p
27712024-12-21T00:56:27.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50765 req_id = 9a030321-e753-4d38-8ba9-b43804675dda response_code = 200 uri = /network-bootstore-config
27722024-12-21T00:56:27.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47225 req_id = af80f086-b829-428e-a2ff-cc03d6fa896a response_code = 200 uri = /network-bootstore-config
27732024-12-21T00:56:29.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7455 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 618f957d-0eef-4113-a355-f21860740a71 response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
27742024-12-21T00:56:35.094ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43493
27752024-12-21T00:56:35.094ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43493 req_id = 69615bee-b942-402c-8e9b-092d86aeabfe response_code = 200 uri = /baseboard
27762024-12-21T00:56:55.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50407
27772024-12-21T00:56:55.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50407 req_id = cc53372f-ea3d-4e01-baf9-5b075db98880 response_code = 200 uri = /vpc-routes
27782024-12-21T00:56:55.825ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
27792024-12-21T00:56:55.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50407 req_id = ee589923-8f9d-4c06-8fb4-ceadc45b0736 response_code = 204 uri = /eip-gateways
27802024-12-21T00:56:55.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50407 req_id = 5a5ee51f-0a7d-4797-a877-caafa20337d1 response_code = 204 uri = /vpc-routes
27812024-12-21T00:56:55.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51199
27822024-12-21T00:56:55.875ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27832024-12-21T00:56:55.910ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27842024-12-21T00:56:55.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93692 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51199 req_id = c0ffe9dd-e66c-41bc-876e-8d5dafaedec8 response_code = 204 uri = /switch-ports
27852024-12-21T00:56:55.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51199 req_id = 4511993e-086e-4d7f-ae4d-3b2e894ad2e6 response_code = 200 uri = /network-bootstore-config
27862024-12-21T00:56:55.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64644
27872024-12-21T00:56:55.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64644 req_id = 80000bc6-0cec-461f-bfb6-6db26214d432 response_code = 200 uri = /v2p
27882024-12-21T00:56:56.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56860
27892024-12-21T00:56:56.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56860 req_id = 9a24595a-c539-4604-a782-be5a1c49446b response_code = 200 uri = /v2p
27902024-12-21T00:56:56.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33784
27912024-12-21T00:56:56.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33784 req_id = e57865d6-0dc3-445e-aa08-bbc00fdc84e3 response_code = 200 uri = /vpc-routes
27922024-12-21T00:56:56.883ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
27932024-12-21T00:56:56.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33784 req_id = c90e63b6-f786-4f4b-9e0c-3aa7550c89de response_code = 204 uri = /eip-gateways
27942024-12-21T00:56:56.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33784 req_id = dc9b195f-fbe7-487e-afb1-6c83664617ad response_code = 204 uri = /vpc-routes
27952024-12-21T00:56:56.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52628
27962024-12-21T00:56:56.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52628 req_id = 0e0ea269-c44c-4aa0-8bf5-77d119a0e36a response_code = 200 uri = /vpc-routes
27972024-12-21T00:56:56.977ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
27982024-12-21T00:56:56.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52628 req_id = b08c6544-6cc5-445e-af7d-992edb73925c response_code = 204 uri = /eip-gateways
27992024-12-21T00:56:56.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57159
28002024-12-21T00:56:56.981ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28012024-12-21T00:56:57.020ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28022024-12-21T00:56:57.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98257 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57159 req_id = 8382a3d1-0346-43c6-9277-83f34a4d6ff3 response_code = 204 uri = /switch-ports
28032024-12-21T00:56:57.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57159 req_id = 81bb93ec-3ed0-47d3-975c-3a16b6f32ed7 response_code = 200 uri = /network-bootstore-config
28042024-12-21T00:56:57.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52628 req_id = 53e5cab4-b30f-435e-9d3c-34438d342bb5 response_code = 204 uri = /vpc-routes
28052024-12-21T00:56:57.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63785
28062024-12-21T00:56:57.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63785 req_id = c9f1c10b-23de-435b-8a8a-2838fbbfcd6f response_code = 200 uri = /v2p
28072024-12-21T00:56:57.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57569
28082024-12-21T00:56:57.174ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28092024-12-21T00:56:57.214ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28102024-12-21T00:56:57.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99977 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57569 req_id = d9027d7f-8969-4022-9a68-41b3db3356f9 response_code = 204 uri = /switch-ports
28112024-12-21T00:56:57.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57569 req_id = a079b0d6-8796-4429-b8b5-2b2c7c82dd4d response_code = 200 uri = /network-bootstore-config
28122024-12-21T00:56:59.739ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6860 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = d15373bd-ea36-49bb-8e39-0cfe31a6afa4 response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
28132024-12-21T00:57:05.127ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61660
28142024-12-21T00:57:05.127ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61660 req_id = 0708c79e-7769-4487-88b4-7733b501c6d4 response_code = 200 uri = /baseboard
28152024-12-21T00:57:25.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49189
28162024-12-21T00:57:25.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49189 req_id = e3a9bb8e-40a1-408f-b0fa-9ed5b74244e7 response_code = 200 uri = /v2p
28172024-12-21T00:57:25.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53870
28182024-12-21T00:57:25.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53870 req_id = 61cc41d3-af56-4a60-abdb-e142e5ef57af response_code = 200 uri = /vpc-routes
28192024-12-21T00:57:25.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
28202024-12-21T00:57:25.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53870 req_id = 94b4e475-3b3d-447f-91dd-66ba1abd9c94 response_code = 204 uri = /eip-gateways
28212024-12-21T00:57:25.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53870 req_id = 4510d9c6-5688-4018-944a-c06e5dfb3a1f response_code = 204 uri = /vpc-routes
28222024-12-21T00:57:25.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41191
28232024-12-21T00:57:25.816ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28242024-12-21T00:57:25.854ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28252024-12-21T00:57:25.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89104 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41191 req_id = 7aa0763e-ac76-4e60-9319-ffc9b0de04cd response_code = 204 uri = /switch-ports
28262024-12-21T00:57:25.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41191 req_id = 564a17a3-3167-4e0f-a70f-1d31ec278ef7 response_code = 200 uri = /network-bootstore-config
28272024-12-21T00:57:26.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54752
28282024-12-21T00:57:26.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54752 req_id = e32046be-2687-4f53-9541-7a46fc8032dc response_code = 200 uri = /vpc-routes
28292024-12-21T00:57:26.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41419
28302024-12-21T00:57:26.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41419 req_id = 54a883e5-a6c2-404d-be13-4a42f6861055 response_code = 200 uri = /v2p
28312024-12-21T00:57:26.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40190
28322024-12-21T00:57:26.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40190 req_id = a05e84f5-5bbb-4312-ace6-ede5d6988083 response_code = 200 uri = /vpc-routes
28332024-12-21T00:57:26.837ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
28342024-12-21T00:57:26.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54752 req_id = 5f169dea-b86b-4ac2-9d48-9b727073ceb3 response_code = 204 uri = /eip-gateways
28352024-12-21T00:57:26.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54752 req_id = d8070af2-41a7-42e7-80b4-e708ef4b9805 response_code = 204 uri = /vpc-routes
28362024-12-21T00:57:26.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52230
28372024-12-21T00:57:26.859ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28382024-12-21T00:57:26.901ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28392024-12-21T00:57:26.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100037 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52230 req_id = 0448c783-8a1e-4157-bc46-e740903ca261 response_code = 204 uri = /switch-ports
28402024-12-21T00:57:26.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37874
28412024-12-21T00:57:26.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47919
28422024-12-21T00:57:26.960ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
28432024-12-21T00:57:26.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40190 req_id = 41a6bdc9-c81a-4466-a7dd-f58484f4a050 response_code = 204 uri = /eip-gateways
28442024-12-21T00:57:26.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37874 req_id = 792e1e62-275d-4b9a-9f6d-1cd790f3687b response_code = 200 uri = /v2p
28452024-12-21T00:57:26.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52230 req_id = 431ba76b-4ca8-43ef-9d4b-bb49142d1ef0 response_code = 200 uri = /network-bootstore-config
28462024-12-21T00:57:26.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28472024-12-21T00:57:26.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40190 req_id = b9449236-d76c-488d-a9b7-fb8d3c5b6ce7 response_code = 204 uri = /vpc-routes
28482024-12-21T00:57:27.002ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28492024-12-21T00:57:27.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104687 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47919 req_id = 4ec4f44f-71f4-4242-afb1-a1a9499908e2 response_code = 204 uri = /switch-ports
28502024-12-21T00:57:27.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47919 req_id = 1efce294-fd79-45ca-b394-514f43c4ea56 response_code = 200 uri = /network-bootstore-config
28512024-12-21T00:57:29.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8370 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 79106b6e-d48e-4f11-a4fb-41449d8b889b response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
28522024-12-21T00:57:35.160ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44568
28532024-12-21T00:57:35.160ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44568 req_id = 21589177-a84c-4b2a-9e66-cc625588ab2d response_code = 200 uri = /baseboard
28542024-12-21T00:57:55.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38377
28552024-12-21T00:57:55.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38377 req_id = ba281fc3-37af-4bb3-b57c-1c35192da0a6 response_code = 200 uri = /v2p
28562024-12-21T00:57:55.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47215
28572024-12-21T00:57:55.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47215 req_id = ae8d2c97-4e2e-4ae7-8827-b9366c4e7cba response_code = 200 uri = /vpc-routes
28582024-12-21T00:57:55.932ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
28592024-12-21T00:57:55.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47215 req_id = 7415b184-fb5d-4817-b65c-6e148927c90e response_code = 204 uri = /eip-gateways
28602024-12-21T00:57:55.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47215 req_id = f2476b7f-cbfd-4390-b7eb-10353f2d9619 response_code = 204 uri = /vpc-routes
28612024-12-21T00:57:56.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44336
28622024-12-21T00:57:56.030ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28632024-12-21T00:57:56.072ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28642024-12-21T00:57:56.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104192 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44336 req_id = 4bf72e3a-5cf8-4943-af75-c42cda415fb3 response_code = 204 uri = /switch-ports
28652024-12-21T00:57:56.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35289
28662024-12-21T00:57:56.135ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6887e424-c467-4dc7-a8b3-00acc28971d2, kind: Service { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 }, name: Name("external-dns-3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e8e123f1-5057-4c14-a500-5a66ca1807d8, kind: Service { id: 9df62edf-ae77-467e-8386-2594d7931d90 }, name: Name("external-dns-9df62edf-ae77-467e-8386-2594d7931d90"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 190])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104166fa-0281-40e0-a912-f30ba4e7f1c0, kind: Service { id: 3b31669e-ed79-4765-9f80-c063c63fac2d }, name: Name("nexus-3b31669e-ed79-4765-9f80-c063c63fac2d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 150b0c67-783e-4dab-936e-88cb1fe1cda3, kind: Service { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 }, name: Name("nexus-176c56ae-3f0a-4c04-a40a-300d58486e34"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c44fd269-5de0-4bbf-8a47-97be7cf8ce40, kind: Service { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 }, name: Name("nexus-af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28672024-12-21T00:57:56.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28682024-12-21T00:57:56.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28692024-12-21T00:57:56.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28702024-12-21T00:57:56.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28712024-12-21T00:57:56.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28722024-12-21T00:57:56.135ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28732024-12-21T00:57:56.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35289 req_id = 5077c3bc-13c2-4f12-884c-777f6c93a458 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28742024-12-21T00:57:56.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44336 req_id = e06c53d2-271b-43ef-b802-21e1744ec359 response_code = 200 uri = /network-bootstore-config
28752024-12-21T00:57:56.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58199
28762024-12-21T00:57:56.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58199 req_id = 9858099b-6f94-4b58-ba60-7b201db5ac1d response_code = 200 uri = /vpc-routes
28772024-12-21T00:57:56.788ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
28782024-12-21T00:57:56.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58199 req_id = 28741718-b0c2-4f4a-916b-c09b993eef18 response_code = 204 uri = /eip-gateways
28792024-12-21T00:57:56.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51862
28802024-12-21T00:57:56.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51862 req_id = 312ee428-24b4-4ae7-804b-03ab67462b95 response_code = 200 uri = /vpc-routes
28812024-12-21T00:57:56.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63793
28822024-12-21T00:57:56.876ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28832024-12-21T00:57:56.876ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28842024-12-21T00:57:56.876ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:177
28852024-12-21T00:57:56.876ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:177
28862024-12-21T00:57:56.894ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28872024-12-21T00:57:56.894ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_590ffd4f-3c08-4aaa-9320-324eceef269f
28882024-12-21T00:57:56.928ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
28892024-12-21T00:57:56.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51862 req_id = 25260b08-183d-4aa9-b832-16042b328135 response_code = 204 uri = /eip-gateways
28902024-12-21T00:57:56.930ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28912024-12-21T00:57:56.930ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c679f342-f128-44a0-ab2d-f59379b9850c
28922024-12-21T00:57:56.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51862 req_id = b545a9d7-031a-48ff-b47d-8956111cb8fb response_code = 204 uri = /vpc-routes
28932024-12-21T00:57:56.966ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28942024-12-21T00:57:56.966ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_73f3806f-f01a-4ed9-9018-33c83b997a06
28952024-12-21T00:57:57.003ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28962024-12-21T00:57:57.003ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b745a-6af3-41e8-a39a-73607778df7f
28972024-12-21T00:57:57.032ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28982024-12-21T00:57:57.032ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a
28992024-12-21T00:57:57.058ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29002024-12-21T00:57:57.059ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a
29012024-12-21T00:57:57.085ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29022024-12-21T00:57:57.085ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99
29032024-12-21T00:57:57.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65343
29042024-12-21T00:57:57.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65343 req_id = 7e59ce41-a655-498f-b21c-667e7fa2c87e response_code = 200 uri = /v2p
29052024-12-21T00:57:57.109ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29062024-12-21T00:57:57.109ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb
29072024-12-21T00:57:57.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65476
29082024-12-21T00:57:57.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65476 req_id = 4dc00565-726a-4799-8256-daa0835e39a3 response_code = 200 uri = /v2p
29092024-12-21T00:57:57.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58199 req_id = 3ee0e5f1-eb67-48e8-afe8-b1de9a938c39 response_code = 204 uri = /vpc-routes
29102024-12-21T00:57:57.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59079
29112024-12-21T00:57:57.130ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29122024-12-21T00:57:57.139ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29132024-12-21T00:57:57.139ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b
29142024-12-21T00:57:57.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280099 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63793 req_id = f365617c-042a-4cfb-8d3e-62f5bd6206dc response_code = 200 uri = /inventory
29152024-12-21T00:57:57.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52200
29162024-12-21T00:57:57.177ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29172024-12-21T00:57:57.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54086
29182024-12-21T00:57:57.197ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29192024-12-21T00:57:57.197ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29202024-12-21T00:57:57.198ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:177
29212024-12-21T00:57:57.198ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:177
29222024-12-21T00:57:57.214ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29232024-12-21T00:57:57.214ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_590ffd4f-3c08-4aaa-9320-324eceef269f
29242024-12-21T00:57:57.248ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29252024-12-21T00:57:57.248ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c679f342-f128-44a0-ab2d-f59379b9850c
29262024-12-21T00:57:57.254ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
29272024-12-21T00:57:57.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124275 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59079 req_id = c3ad1380-e3f8-4b30-b613-e18a80864ea4 response_code = 204 uri = /switch-ports
29282024-12-21T00:57:57.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 694 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59079 req_id = 260f42c6-53bf-43c0-a8ad-3cd94f1c590f response_code = 200 uri = /network-bootstore-config
29292024-12-21T00:57:57.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54314
29302024-12-21T00:57:57.275ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29312024-12-21T00:57:57.275ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29322024-12-21T00:57:57.275ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/config/omicron-zones.json file = common/src/ledger.rs:177
29332024-12-21T00:57:57.276ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/config/omicron-zones.json file = common/src/ledger.rs:177
29342024-12-21T00:57:57.280ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29352024-12-21T00:57:57.281ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_73f3806f-f01a-4ed9-9018-33c83b997a06
29362024-12-21T00:57:57.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47296
29372024-12-21T00:57:57.293ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6887e424-c467-4dc7-a8b3-00acc28971d2, kind: Service { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 }, name: Name("external-dns-3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e8e123f1-5057-4c14-a500-5a66ca1807d8, kind: Service { id: 9df62edf-ae77-467e-8386-2594d7931d90 }, name: Name("external-dns-9df62edf-ae77-467e-8386-2594d7931d90"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 190])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104166fa-0281-40e0-a912-f30ba4e7f1c0, kind: Service { id: 3b31669e-ed79-4765-9f80-c063c63fac2d }, name: Name("nexus-3b31669e-ed79-4765-9f80-c063c63fac2d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 150b0c67-783e-4dab-936e-88cb1fe1cda3, kind: Service { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 }, name: Name("nexus-176c56ae-3f0a-4c04-a40a-300d58486e34"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c44fd269-5de0-4bbf-8a47-97be7cf8ce40, kind: Service { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 }, name: Name("nexus-af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29382024-12-21T00:57:57.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29392024-12-21T00:57:57.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29402024-12-21T00:57:57.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29412024-12-21T00:57:57.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
29422024-12-21T00:57:57.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29432024-12-21T00:57:57.293ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29442024-12-21T00:57:57.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 677 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47296 req_id = b27a0e76-fcd4-497b-a802-2415c8504768 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29452024-12-21T00:57:57.299ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 590ffd4f-3c08-4aaa-9320-324eceef269f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29462024-12-21T00:57:57.299ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_590ffd4f-3c08-4aaa-9320-324eceef269f
29472024-12-21T00:57:57.303ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
29482024-12-21T00:57:57.333ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c679f342-f128-44a0-ab2d-f59379b9850c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29492024-12-21T00:57:57.334ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c679f342-f128-44a0-ab2d-f59379b9850c
29502024-12-21T00:57:57.351ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29512024-12-21T00:57:57.351ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b745a-6af3-41e8-a39a-73607778df7f
29522024-12-21T00:57:57.371ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73f3806f-f01a-4ed9-9018-33c83b997a06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29532024-12-21T00:57:57.372ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_73f3806f-f01a-4ed9-9018-33c83b997a06
29542024-12-21T00:57:57.389ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29552024-12-21T00:57:57.389ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a
29562024-12-21T00:57:57.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218920 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52200 req_id = 3c9dc5cb-ca42-4783-a8b2-76beaaf380cc response_code = 204 uri = /switch-ports
29572024-12-21T00:57:57.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52200 req_id = ad106a5d-485f-4490-bf04-c270f85bec94 response_code = 200 uri = /network-bootstore-config
29582024-12-21T00:57:57.419ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29592024-12-21T00:57:57.419ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a
29602024-12-21T00:57:57.432ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b745a-6af3-41e8-a39a-73607778df7f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29612024-12-21T00:57:57.433ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b745a-6af3-41e8-a39a-73607778df7f
29622024-12-21T00:57:57.450ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29632024-12-21T00:57:57.451ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99
29642024-12-21T00:57:57.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63274
29652024-12-21T00:57:57.457ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6887e424-c467-4dc7-a8b3-00acc28971d2, kind: Service { id: 3bcf1dbd-0e42-4153-a0c3-1510c66bb744 }, name: Name("external-dns-3bcf1dbd-0e42-4153-a0c3-1510c66bb744"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e8e123f1-5057-4c14-a500-5a66ca1807d8, kind: Service { id: 9df62edf-ae77-467e-8386-2594d7931d90 }, name: Name("external-dns-9df62edf-ae77-467e-8386-2594d7931d90"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 190])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 104166fa-0281-40e0-a912-f30ba4e7f1c0, kind: Service { id: 3b31669e-ed79-4765-9f80-c063c63fac2d }, name: Name("nexus-3b31669e-ed79-4765-9f80-c063c63fac2d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 150b0c67-783e-4dab-936e-88cb1fe1cda3, kind: Service { id: 176c56ae-3f0a-4c04-a40a-300d58486e34 }, name: Name("nexus-176c56ae-3f0a-4c04-a40a-300d58486e34"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c44fd269-5de0-4bbf-8a47-97be7cf8ce40, kind: Service { id: af13cdd9-a8ea-4207-84fe-15d8dba9e8a2 }, name: Name("nexus-af13cdd9-a8ea-4207-84fe-15d8dba9e8a2"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 178, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29662024-12-21T00:57:57.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29672024-12-21T00:57:57.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29682024-12-21T00:57:57.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29692024-12-21T00:57:57.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
29702024-12-21T00:57:57.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29712024-12-21T00:57:57.457ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29722024-12-21T00:57:57.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 596 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63274 req_id = bbca41b8-ea99-4e34-8b85-f4bb33d01072 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29732024-12-21T00:57:57.466ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3d38c23a-6d90-4836-a196-d99fb9d10c7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29742024-12-21T00:57:57.466ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3d38c23a-6d90-4836-a196-d99fb9d10c7a
29752024-12-21T00:57:57.491ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ad39f336-254c-44ce-89e1-7fe99a201a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29762024-12-21T00:57:57.491ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ad39f336-254c-44ce-89e1-7fe99a201a7a
29772024-12-21T00:57:57.503ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29782024-12-21T00:57:57.503ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb
29792024-12-21T00:57:57.519ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4ad5e09d-9224-40f8-82f3-d956995ddd99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29802024-12-21T00:57:57.519ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4ad5e09d-9224-40f8-82f3-d956995ddd99
29812024-12-21T00:57:57.532ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29822024-12-21T00:57:57.532ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b
29832024-12-21T00:57:57.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 350596 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54086 req_id = 3d15bf32-0a1d-441b-9047-a99630d09654 response_code = 200 uri = /inventory
29842024-12-21T00:57:57.553ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 497dd4fb-37d8-4e9e-949b-2e6fe415afdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29852024-12-21T00:57:57.553ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_497dd4fb-37d8-4e9e-949b-2e6fe415afdb
29862024-12-21T00:57:57.574ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 48447ed6-1b12-4e40-80f4-de14cb014d3b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29872024-12-21T00:57:57.574ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_48447ed6-1b12-4e40-80f4-de14cb014d3b
29882024-12-21T00:57:57.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311417 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54314 req_id = 0c881ab2-0bdf-42a7-9234-1afa795af8b0 response_code = 200 uri = /inventory
29892024-12-21T00:57:59.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7390 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 8a6d9a19-3020-450f-9ed4-ea19d5cbde24 response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
29902024-12-21T00:58:05.195ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34265
29912024-12-21T00:58:05.195ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34265 req_id = cbed3ffa-6ed6-42c7-9da5-c395901b17c1 response_code = 200 uri = /baseboard
29922024-12-21T00:58:25.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58508
29932024-12-21T00:58:25.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58508 req_id = 04a5c5de-8f93-4b72-9ccd-ad760f82a87d response_code = 200 uri = /vpc-routes
29942024-12-21T00:58:25.678ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
29952024-12-21T00:58:25.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58508 req_id = 7487b707-731e-4dec-95f5-578491c47630 response_code = 204 uri = /eip-gateways
29962024-12-21T00:58:25.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58508 req_id = eb1f6f99-b874-4cf6-8470-d2a8f6342937 response_code = 204 uri = /vpc-routes
29972024-12-21T00:58:25.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53413
29982024-12-21T00:58:25.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53413 req_id = 62f56a89-9eef-42e7-9d92-16f97711b455 response_code = 200 uri = /v2p
29992024-12-21T00:58:25.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35824
30002024-12-21T00:58:25.841ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
30012024-12-21T00:58:25.882ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
30022024-12-21T00:58:25.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95778 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35824 req_id = a3c41ed8-33f6-437d-a500-0f6b4c3b7f2d response_code = 204 uri = /switch-ports
30032024-12-21T00:58:25.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35824 req_id = c4035129-d1bd-49a4-b9ee-25485a4d017d response_code = 200 uri = /network-bootstore-config
30042024-12-21T00:58:26.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40337
30052024-12-21T00:58:26.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40337 req_id = 33293156-79c7-46a6-9fdc-7ac2dfefccab response_code = 200 uri = /vpc-routes
30062024-12-21T00:58:26.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37159
30072024-12-21T00:58:26.770ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
30082024-12-21T00:58:26.813ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
30092024-12-21T00:58:26.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102476 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37159 req_id = 503642fb-e8a4-4482-a62f-642b56e9be3f response_code = 204 uri = /switch-ports
30102024-12-21T00:58:26.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43318
30112024-12-21T00:58:26.873ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
30122024-12-21T00:58:26.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40337 req_id = 550f6c09-8e8f-42fe-bc06-bbe01c6b12a6 response_code = 204 uri = /eip-gateways
30132024-12-21T00:58:26.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37159 req_id = 5d0a8cf1-e890-43d7-8a30-52fb47dfe549 response_code = 200 uri = /network-bootstore-config
30142024-12-21T00:58:26.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43318 req_id = 76cd07d4-98d6-4f3f-b60e-8cae08a19f7a response_code = 200 uri = /v2p
30152024-12-21T00:58:26.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40337 req_id = ab491138-4d29-45a2-85b2-48757e9c3cc6 response_code = 204 uri = /vpc-routes
30162024-12-21T00:58:26.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39161
30172024-12-21T00:58:26.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39161 req_id = 8c813570-bd5c-4bf4-a3bb-7be82c277a58 response_code = 200 uri = /vpc-routes
30182024-12-21T00:58:26.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54629
30192024-12-21T00:58:26.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54629 req_id = ae9445e4-fc37-4aea-ba83-a9991b646399 response_code = 200 uri = /v2p
30202024-12-21T00:58:26.911ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
30212024-12-21T00:58:26.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39161 req_id = 13c65d92-eebd-47d2-909b-99cb8b5bac6d response_code = 204 uri = /eip-gateways
30222024-12-21T00:58:26.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39161 req_id = 9b393c87-ce5e-446a-be2b-13beb1e9ca8d response_code = 204 uri = /vpc-routes
30232024-12-21T00:58:26.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50843
30242024-12-21T00:58:26.957ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
30252024-12-21T00:58:26.996ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
30262024-12-21T00:58:27.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96104 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50843 req_id = 8eca4de6-ca05-4b86-95ee-63ede97b5135 response_code = 204 uri = /switch-ports
30272024-12-21T00:58:27.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50843 req_id = 989c3827-e7d6-4b9d-80c5-b3144c9aa8a9 response_code = 200 uri = /network-bootstore-config
30282024-12-21T00:58:29.739ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7329 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 30acfaba-d224-4016-9b57-42cb64fd89dd response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
30292024-12-21T00:58:31.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64452
30302024-12-21T00:58:31.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64452 req_id = f7569e54-de5b-4190-8c75-757d03e7faca response_code = 200 uri = /v2p
30312024-12-21T00:58:31.940ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(12555921) }
30322024-12-21T00:58:31.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7498 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64452 req_id = 9d330f09-ac46-40a3-9724-5c0e70c6bb82 response_code = 204 uri = /v2p
30332024-12-21T00:58:32.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48212
30342024-12-21T00:58:32.157ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d, kind: Instance { id: e1eb527e-33a5-4fd3-81cd-01741d6d6079 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12555921), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d, kind: Instance { id: e1eb527e-33a5-4fd3-81cd-01741d6d6079 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12555921), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d, kind: Instance { id: e1eb527e-33a5-4fd3-81cd-01741d6d6079 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12555921), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(12555921))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d, kind: Instance { id: e1eb527e-33a5-4fd3-81cd-01741d6d6079 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12555921), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-df3b010f409", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: e2a80714-70f0-4b49-8001-ae8bcc50cf21, read_only_parent: Some(Volume { block_size: 512, id: 516562f3-8341-4759-8900-48946f37dfd7, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: d0ca87ba-7c60-4154-9a80-6ecd52c75700, key: Some("6+Y7UTqClghDkOL8wrbVEXHvvQJXqXHHk9rBqNc8pr4="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e2a80714-70f0-4b49-8001-ae8bcc50cf21, key: Some("6bu8CpbSbYzqCGEV+kipA/WhiJt7raI3Jx1MVFEowCk="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::19]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-df3b010f409" }] }), cloud_init_bytes: Some(..) } instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 metadata = InstanceMetadata { silo_id: 290edf7d-0c1b-44e3-9f32-663c2b7cfbf8, project_id: 9251049f-215b-46a7-80c9-0c60627cd269 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T00:58:32.147482473Z }
30352024-12-21T00:58:32.157ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 migration_id = None propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30362024-12-21T00:58:32.157ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 migration_id = None propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d, kind: Instance { id: e1eb527e-33a5-4fd3-81cd-01741d6d6079 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12555921), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d, kind: Instance { id: e1eb527e-33a5-4fd3-81cd-01741d6d6079 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12555921), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d, kind: Instance { id: e1eb527e-33a5-4fd3-81cd-01741d6d6079 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12555921), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(12555921))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d, kind: Instance { id: e1eb527e-33a5-4fd3-81cd-01741d6d6079 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12555921), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-df3b010f409", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: e2a80714-70f0-4b49-8001-ae8bcc50cf21, read_only_parent: Some(Volume { block_size: 512, id: 516562f3-8341-4759-8900-48946f37dfd7, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: d0ca87ba-7c60-4154-9a80-6ecd52c75700, key: Some("6+Y7UTqClghDkOL8wrbVEXHvvQJXqXHHk9rBqNc8pr4="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e2a80714-70f0-4b49-8001-ae8bcc50cf21, key: Some("6bu8CpbSbYzqCGEV+kipA/WhiJt7raI3Jx1MVFEowCk="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::19]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-df3b010f409" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T00:58:32.147482473Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
30372024-12-21T00:58:32.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48212 req_id = c7555efc-b49e-4e95-8141-e3fbd0d70896 response_code = 200 uri = /vmms/96f5563d-519f-4f84-832f-18f3f8c399d3
30382024-12-21T00:58:32.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53047
30392024-12-21T00:58:32.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 741 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53047 req_id = 96fce49a-eda3-4a7d-bf9a-99b3fd7caefe response_code = 200 uri = /vmms/96f5563d-519f-4f84-832f-18f3f8c399d3/state
30402024-12-21T00:58:32.365ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 12555921 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
30412024-12-21T00:58:32.365ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30422024-12-21T00:58:32.402ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3 file = illumos-utils/src/zone.rs:325 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30432024-12-21T00:58:32.425ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3 file = illumos-utils/src/zone.rs:363 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30442024-12-21T00:58:32.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42945
30452024-12-21T00:58:32.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42945 req_id = 4cb3de9f-e6fd-4d2e-b441-45a7e4d3f703 response_code = 200 uri = /vpc-routes
30462024-12-21T00:58:32.535ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d: {10.151.2.175: {a1947548-39bb-4358-8501-6fad6d7ceed9}, 10.151.2.176: {a1947548-39bb-4358-8501-6fad6d7ceed9}}} }
30472024-12-21T00:58:34.064ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30482024-12-21T00:58:34.064ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3 zone file = illumos-utils/src/running_zone.rs:488 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 zone = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30492024-12-21T00:58:34.246ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 35.41019ms file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 zone = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30502024-12-21T00:58:34.292ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 133.275539ms file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 zone = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30512024-12-21T00:58:34.443ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 269.057593ms file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 zone = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30522024-12-21T00:58:34.729ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 418.295012ms file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 zone = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30532024-12-21T00:58:35.163ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 850.558385ms file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 zone = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30542024-12-21T00:58:35.243ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39804
30552024-12-21T00:58:35.243ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39804 req_id = 556d6142-edfe-4944-b25b-8d3e146e9748 response_code = 200 uri = /baseboard
30562024-12-21T00:58:36.023ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 1.062159211s file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 zone = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30572024-12-21T00:58:37.097ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 1.081627105s file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 zone = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30582024-12-21T00:58:38.191ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 1.118795062s file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 zone = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30592024-12-21T00:58:39.323ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 948.183683ms file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 zone = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30602024-12-21T00:58:40.283ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 931.104135ms file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 zone = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30612024-12-21T00:58:41.244ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3 file = sled-agent/src/instance.rs:1786 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30622024-12-21T00:58:41.253ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 72.261795ms file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30632024-12-21T00:58:41.336ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 105.983128ms file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30642024-12-21T00:58:41.453ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3") failed: Property not found. retry in 294.675134ms file = illumos-utils/src/svc.rs:36 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30652024-12-21T00:58:41.759ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30662024-12-21T00:58:41.820ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30672024-12-21T00:58:41.963ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30682024-12-21T00:58:41.964ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
30692024-12-21T00:58:41.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9429108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42945 req_id = 1cf49ef1-c9ff-428a-8339-93b781cd647e response_code = 204 uri = /eip-gateways
30702024-12-21T00:58:41.965ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-21T00:58:41.965300054Z } file = sled-agent/src/instance.rs:780 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30712024-12-21T00:58:41.965ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T00:58:41.965300054Z } propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30722024-12-21T00:58:41.965ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T00:58:41.965300054Z }, migration_in: None, migration_out: None }
30732024-12-21T00:58:42.071ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-21T00:58:42.070974255Z } file = sled-agent/src/instance.rs:780 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30742024-12-21T00:58:42.071ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T00:58:42.070974255Z } propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30752024-12-21T00:58:42.071ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T00:58:42.070974255Z }, migration_in: None, migration_out: None }
30762024-12-21T00:58:42.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 560 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42945 req_id = 2eb45d9b-8024-4d01-b7cc-0ea480e8b2cb response_code = 204 uri = /vpc-routes
30772024-12-21T00:58:51.920ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
30782024-12-21T00:58:55.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55533
30792024-12-21T00:58:55.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 721 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55533 req_id = 13ec4552-f032-4aa3-8260-edf860890bfb response_code = 200 uri = /vmms/96f5563d-519f-4f84-832f-18f3f8c399d3/state
30802024-12-21T00:58:55.192ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-21T00:58:55.192744176Z } file = sled-agent/src/instance.rs:780 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30812024-12-21T00:58:55.192ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T00:58:55.192744176Z } propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30822024-12-21T00:58:55.192ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T00:58:55.192744176Z }, migration_in: None, migration_out: None }
30832024-12-21T00:58:55.230ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-21T00:58:55.230301833Z } file = sled-agent/src/instance.rs:780 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30842024-12-21T00:58:55.230ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-21T00:58:55.230301833Z } propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30852024-12-21T00:58:55.230ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30862024-12-21T00:58:55.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30872024-12-21T00:58:55.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30882024-12-21T00:58:55.231ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 7033088741804108722 n_samples = 6 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
30892024-12-21T00:58:55.231ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 10383867403834716869 n_samples = 6 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
30902024-12-21T00:58:55.231ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/a497e4d0-db89-46cf-a340-ab52cdcea7e0/debug/bundle/zone", "/pool/int/be00bd5f-3434-4c14-9c45-f233f78ceaf1/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/590ffd4f-3c08-4aaa-9320-324eceef269f/crypt/debug", "/pool/ext/c679f342-f128-44a0-ab2d-f59379b9850c/crypt/debug", "/pool/ext/73f3806f-f01a-4ed9-9018-33c83b997a06/crypt/debug", "/pool/ext/d31b745a-6af3-41e8-a39a-73607778df7f/crypt/debug", "/pool/ext/3d38c23a-6d90-4836-a196-d99fb9d10c7a/crypt/debug", "/pool/ext/ad39f336-254c-44ce-89e1-7fe99a201a7a/crypt/debug", "/pool/ext/4ad5e09d-9224-40f8-82f3-d956995ddd99/crypt/debug", "/pool/ext/497dd4fb-37d8-4e9e-949b-2e6fe415afdb/crypt/debug", "/pool/ext/48447ed6-1b12-4e40-80f4-de14cb014d3b/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3
30912024-12-21T00:58:55.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48084
30922024-12-21T00:58:55.934ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3", bundle_id: 204bbba8-7ece-4951-abc4-512252f96be7 }, time_created: 2024-12-21T00:58:55.232710087Z, version: 0, cause: TerminatedInstance }
30932024-12-21T00:58:55.934ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_96f5563d-519f-4f84-832f-18f3f8c399d3 file = sled-agent/src/instance.rs:1032 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
30942024-12-21T00:58:56.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49928
30952024-12-21T00:58:56.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49928 req_id = c11cb1a0-3cff-4c1f-8633-ba7dd892cf3d response_code = 200 uri = /vpc-routes
30962024-12-21T00:58:56.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d: {10.151.2.175: {a1947548-39bb-4358-8501-6fad6d7ceed9}, 10.151.2.176: {a1947548-39bb-4358-8501-6fad6d7ceed9}}} }
30972024-12-21T00:58:56.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49928 req_id = 5c75f647-ef18-4e8c-8113-3c68ad952714 response_code = 204 uri = /eip-gateways
30982024-12-21T00:58:56.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49928 req_id = ad7b1190-a238-4a5a-9959-4544c9e59904 response_code = 204 uri = /vpc-routes
30992024-12-21T00:58:56.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60842
31002024-12-21T00:58:56.110ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
31012024-12-21T00:58:56.148ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
31022024-12-21T00:58:56.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60842 req_id = 2129d591-21d1-4e5d-9257-63f62e289e0b response_code = 204 uri = /switch-ports
31032024-12-21T00:58:56.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47494
31042024-12-21T00:58:56.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60842 req_id = 87051ebe-62b2-433f-a468-dc177a494a48 response_code = 200 uri = /network-bootstore-config
31052024-12-21T00:58:56.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47494 req_id = 21465a7a-6688-472f-aa1d-999a14d82f7e response_code = 200 uri = /v2p
31062024-12-21T00:58:56.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37967
31072024-12-21T00:58:56.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37967 req_id = 8a954f53-11f4-4797-984f-d15eef2931af response_code = 200 uri = /vpc-routes
31082024-12-21T00:58:56.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64678
31092024-12-21T00:58:56.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64678 req_id = 6fa59b33-735c-46c3-be07-4b3907196b81 response_code = 200 uri = /v2p
31102024-12-21T00:58:56.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64990
31112024-12-21T00:58:56.975ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d: {10.151.2.175: {a1947548-39bb-4358-8501-6fad6d7ceed9}, 10.151.2.176: {a1947548-39bb-4358-8501-6fad6d7ceed9}}} }
31122024-12-21T00:58:56.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37967 req_id = 08b37465-da7d-4a5c-bd8f-b63f6d93d9cc response_code = 204 uri = /eip-gateways
31132024-12-21T00:58:56.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37967 req_id = daea2574-450a-4fa1-8913-0326bd48f132 response_code = 204 uri = /vpc-routes
31142024-12-21T00:58:57.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33650
31152024-12-21T00:58:57.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59821
31162024-12-21T00:58:57.055ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
31172024-12-21T00:58:57.096ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
31182024-12-21T00:58:57.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107818 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59821 req_id = d9348fa3-1867-41ed-8619-5dbd70c47af5 response_code = 204 uri = /switch-ports
31192024-12-21T00:58:57.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63257
31202024-12-21T00:58:57.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63257 req_id = 9e473de8-1b0a-43cc-b86c-25c6c82f58fc response_code = 200 uri = /vpc-routes
31212024-12-21T00:58:57.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59821 req_id = 920d4d60-2551-4479-94ac-3ffbc3d3a87a response_code = 200 uri = /network-bootstore-config
31222024-12-21T00:58:57.207ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {a25c2cf9-5fe3-4f93-9ef6-dfc8a60dbd7d: {10.151.2.175: {a1947548-39bb-4358-8501-6fad6d7ceed9}, 10.151.2.176: {a1947548-39bb-4358-8501-6fad6d7ceed9}}} }
31232024-12-21T00:58:57.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63257 req_id = 73662a4c-2e57-4506-8613-73ebf3b90838 response_code = 204 uri = /eip-gateways
31242024-12-21T00:58:57.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60912
31252024-12-21T00:58:57.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60912 req_id = 4cf23714-8acf-4539-be21-c80ed0f85e50 response_code = 200 uri = /v2p
31262024-12-21T00:58:57.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38103
31272024-12-21T00:58:57.235ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
31282024-12-21T00:58:57.276ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
31292024-12-21T00:58:57.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102279 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38103 req_id = 4707cf85-cd39-4697-8c68-66676a6fc065 response_code = 204 uri = /switch-ports
31302024-12-21T00:58:57.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38103 req_id = fd09ab4d-cd98-4e6e-9579-f791379c60a6 response_code = 200 uri = /network-bootstore-config
31312024-12-21T00:58:57.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 414 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63257 req_id = 3512b291-59d0-472f-8ea7-4bb8faea9f50 response_code = 204 uri = /vpc-routes
31322024-12-21T00:58:57.758ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
31332024-12-21T00:58:57.774ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(12555921), kind: System }
31342024-12-21T00:58:57.774ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(12555921), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
31352024-12-21T00:58:57.776ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T00:58:57.776872402Z }, migration_in: None, migration_out: None }
31362024-12-21T00:58:57.841ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T00:58:57.776872402Z }, migration_in: None, migration_out: None }
31372024-12-21T00:58:57.845ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = e1eb527e-33a5-4fd3-81cd-01741d6d6079 propolis_id = 96f5563d-519f-4f84-832f-18f3f8c399d3
31382024-12-21T00:58:57.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 949352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64990 req_id = 8434feee-2545-4284-8d04-df3ee25f1c54 response_code = 200 uri = /vmms/96f5563d-519f-4f84-832f-18f3f8c399d3/state
31392024-12-21T00:58:57.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020069 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48084 req_id = 6c3e3866-60b1-493d-877e-883749637a8c response_code = 200 uri = /vmms/96f5563d-519f-4f84-832f-18f3f8c399d3/state
31402024-12-21T00:58:57.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 834815 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33650 req_id = 1d76836d-0148-44a0-98cc-103f5079d0d0 response_code = 200 uri = /vmms/96f5563d-519f-4f84-832f-18f3f8c399d3/state
31412024-12-21T00:58:58.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53687
31422024-12-21T00:58:58.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53687 req_id = 007f414c-1696-441b-a7c9-4e3d20b829da response_code = 200 uri = /vpc-routes
31432024-12-21T00:58:58.417ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
31442024-12-21T00:58:58.417ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
31452024-12-21T00:58:58.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53687 req_id = 70c3a8c3-d802-483d-841c-79a70783f9d7 response_code = 204 uri = /eip-gateways
31462024-12-21T00:58:58.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53687 req_id = dbc7dbe4-0145-4139-ae7f-ececbe34b463 response_code = 204 uri = /vpc-routes
31472024-12-21T00:58:58.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58654
31482024-12-21T00:58:58.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58654 req_id = 5ad1bd67-44b3-4656-bf78-f338fcf1adca response_code = 200 uri = /v2p
31492024-12-21T00:58:59.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52140
31502024-12-21T00:58:59.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52140 req_id = 6097efd9-5576-4954-b921-d1872e5e1237 response_code = 200 uri = /v2p
31512024-12-21T00:58:59.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41066
31522024-12-21T00:58:59.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41066 req_id = 3b6f8e7c-1225-42d2-829a-b6613abaa50e response_code = 200 uri = /vpc-routes
31532024-12-21T00:58:59.504ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
31542024-12-21T00:58:59.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41066 req_id = 9c8cf4f1-a5e9-4642-ba79-56ca6f2bfc3c response_code = 204 uri = /eip-gateways
31552024-12-21T00:58:59.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41066 req_id = d0330828-cea6-4846-9717-f4d5a57e59a8 response_code = 204 uri = /vpc-routes
31562024-12-21T00:58:59.740ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8077 local_addr = [fd00:1122:3344:101::1]:63341 method = GET remote_addr = [fd00:1122:3344:101::d]:54850 req_id = 99b6ee8c-71fb-4a15-ba84-442fe76ea72f response_code = 200 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c uri = /bf099da7-dcc9-4db5-96e6-2fb4244a4a3c
31572024-12-21T00:59:00.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64362
31582024-12-21T00:59:00.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64362 req_id = d15ecac5-d5f9-4dcb-a946-78d48d205878 response_code = 200 uri = /vpc-routes
31592024-12-21T00:59:00.386ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bf099da7-dcc9-4db5-96e6-2fb4244a4a3c values = ExternalIpGatewayMap { mappings: {} }
31602024-12-21T00:59:00.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64362 req_id = 78e59d62-67c1-4e19-8738-7e24f72648af response_code = 204 uri = /eip-gateways
31612024-12-21T00:59:00.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64362 req_id = 5317f054-270d-4342-b2d8-91024b08851d response_code = 204 uri = /vpc-routes